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Preface 


This book was begun when I was a graduate student in applied math- 
ematics at the California Institute of Technology. Being able to integrate 
functions easily is a skill that is presumed at the graduate level. Yet, some 
integrals can only be simplified by using clever manipulations. I found it 
useful to create a list of manipulation techniques. Each technique on this 
list had a brief description of how the method was used and to what types 
of integrals it applied. As I learned more techniques they were added to 
the list. This book is a direct outgrowth of that list. 

In performing mathematical analysis, analytic evaluation of integrals 
is often required. Other times, an approximate integration may be more 
informative than a representation of the exact answer. (The exact repre- 
sentation could, for example, be in the form of an infinite series.) Lastly, a 
numerical approximation to an integral may be all that is required in some 
applications. 

This book is therefore divided into five sections: 

e Applications of Integration which shows how integration is used in 
differential equations, geometry, probability and performing summa- 
tions; 

e Concepts and Definitions which defines several different types of inte- 
grals and operations on them; 

e Exact Techniques which indicates several ways in which integrals may 
be evaluated exactly; 

e Approximate Techniques which indicates several ways in which inte- 
grals may be evaluated approximately; and 

e Numerical Techniques which indicates several ways in which integrals 
may be evaluated numerically. 

This handbook has been designed as a reference book. Many of the 
techniques in this book are standard in an advanced course in mathematical 
methods. Each technique is accompanied by several current references; 


ix 
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these allow each topic to be studied in more detail. This book should be 
useful to students and also to practicing engineers or scientists who must 
evaluate integrals on an occasional basis. 

Had this book been available when I was a graduate student, it would 
have saved me much time. It has saved me time in evaluating integrals 
that arose from my own work in industry (the Jet Propulsion Laboratory, 
Sandia Laboratories, EXXON Research and Engineering, and the MITRE 
Corporation). 

Unfortunately, there may still be some errors in the text; I would 
greatly appreciate receiving notice of any such errors. Please send these 
comments care of Jones and Bartlett. 

No book is created in a vacuum, and this one is no exception. Thanks 
are extended to Harry Dym, David K. Kahaner, Jay Ramanthan, Doug 
Reinelt, and Michael Strauss for reviewing the manuscript. Their help has 
been instrumental in clarifying the text. Lastly, this book would have not 
been possible without the enthusiasm of my editor, Alice Peters. 


Boston, MA 1992 Daniel Zwillinger 


Introduction 


This book is a compilation of the most important and widely applicable 
methods for evaluating and approximating integrals. As a reference book, it 
provides convenient access to these methods and contains examples showing 
their use. 

The book is divided into five parts. The first part lists several appli- 
cations of integration. The second part contains definitions and concepts 
and has some useful transformations of integrals. This section of the book 
defines many different types of integrals, indicates what Feynman diagrams 
are, and describes many useful transformations. 

The third part of the book is a collection of exact analytical evaluation 
techniques for integrals. For nearly every technique the following are given: 


- the types of integrals to which the method is applicable 

- the idea behind the method 

- the procedure for carrying out the method 

- at least one simple example of the method 

- notes for more advanced users 

- references to the literature for more discussion or examples. 


The material for each method has deliberately been kept short to 
simplify use. Proofs have been intentionally omitted. 

It is hoped that, by working through the simple example(s) given, the 
method will be understood. Enough insight should be gained from working 
the example(s) to apply the method to other integrals. References are given 
for each method so that the principle may be studied in more detail, or 
more examples seen. Note that not all of the references listed at the end 
of a section may be referred to in the text. 

The author has found that computer languages that perform symbolic 
manipulations (such as Macsyma) are very useful when performing the 
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calculations necessary to analyze integrals. Examples of several symbolic 
manipulation computer languages are given. | 

Not all integrals can be evaluated analytically in terms of elementary 
functions; sometimes an approximate evaluation will have to do. Other 
times, an approximate evaluation may be more useful than an exact eval- 
uation. For instance, an exact evaluation in terms of a slowly converging 
infinite series may be laborious to approximate numerically. The same 
integral may have a simple approximation that indicates some characteristic 
behavior or easily allows a numerical value to be obtained. 

The fourth part of this book deals with approximate analytical solution 
techniques. For the methods in this part of the book, the format is similar 
to that used for the exact solution techniques. We classify a method as 
an approximate method if it gives some information about the value of 
an integral but will not specify the value of the integral at all values of 
the independent variable(s) appearing in the integral. The methods in 
this section describe, for example, the method of stationary phase and the 
method of steepest descent. 

When an exact or an approximate solution technique cannot be found, 
it may be necessary to find the solution numerically. Other times, a 
numerical solution may convey more information than an exact or approx- 
imate analytical solution. The fifth part of this book deals with the most 
important methods for obtaining numerical approximations to integrals. 
From a vast literature of techniques available for numerically approximating 
integrals, this book has only tried to illustrate some of the more important 
techniques. At the beginning of the fifth section is a brief introduction to 
the concepts and terms used in numerical methods. 

This book is not designed to be read at one sitting. Rather, it should 
be consulted as needed. This book contains many references to other books. 
While some books cover only one or two topics well, some books cover all 
their topics well. The following books are recommended as a first source 
for detailed understanding of the integration techniques they cover: Each 
is broad in scope and easy to read. 


References 

[1] C. M. Bender and S. A. Orszag, Advanced Mathematical Methods for Scien- 
tists and Engineers, McGraw-Hill, New York, 1978. 

[2] P. J. Davis and P. Rabinowitz, Methods of Numerical Integration, Second 
Edition, Academic Press, Orlando, Florida, 1984. 

[3] W. Squire, Integration for Engineers and Scientists, American Elsevier Pub- 
lishing Company, New York, 1970. 


How to Use This Book 


This book has been designed to be easy to use when evaluating inte- 
grals, whether exactly, approximately, or numerically. This introductory 
section outlines how this book may be used to analyze a given integral. 

First, determine if the integral has been studied in the literature. A 
list of many integrals may be found in the “Look Up Technique” section 
beginning on page 170. If the integral you wish to analyze is contained 
in one of the lists in that section, then see the indicated reference. This 
technique is the single most useful technique in this book. 


Special Forms 


(1] If the integral has a special form, then it may be evaluated in closed 
form without too much difficulty. If the integral has the form: 


(A) {* R(x)dx, where R(x) is a rational function then the integral 
can be evaluated in terms of logarithms and arc-tangents (see 
page 183). 

(B) [* P(x, VR) log Q(x, VR) dx, where P(, ) and Q(, ) are rational 
functions and R = A? + Br + Cz?, then the integral can be 
evaluated in terms of dilogarithms (see page 145). 

(C) {* R(x, \/T(x)) dz where R(, ) is a rational function of its ar- 
guments and T(z) is a third of fourth order polynomial, then 
the integral can be evaluated in terms of elliptic functions (see 
page 147). 

(D) i * f(cos @,sin @) d0, then the integral may be re-formulated as a 
contour integral (see page 129). 

[2] If the integral is a contour integral, see page 129. 
[3] If the integral is a path integral, see page 86. 
[4] If the integral is a principal-value integral (i.e., the integral sign looks 

like ), then see page 92. 


[5] 
[6] 


[7] 
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If the integral is a finite-part integral (i.e., the integral sign looks like 
#), then see page 73. 

If the integral is a loop integral (i.e, the integral sign looks like $), or 
if the integration is over a closed curve in the complex plane, then see 
pages 129 or 164. 

If the integral appears to be divergent, then the integral might need 
to be interpreted as a principal-value integral (see page 92) or as a 
finite-part integral (see page 73). 


Looking for an Exact Evaluation 


[1] 
[2] 


If you have access to a symbolic manipulation computer language (such 
as Maple, Macsyma, or Derive), then see page 117. 

For a given integral, if one integration technique does not work, try 
another. Most integrals that can be analytically evaluated can be 
evaluated by more than one technique. For example, the integral 


CO cs 
r= [ ay 
0 Zz 


is shown to converge on page 66. Then J is evaluated (using different 
methods) on pages 118, 133, 144, 145, and 185. 


Looking for an Approximate Evaluation 


[1] 


[2] 


If is large, C is an integration contour, and the integral has the form: 

(A) J, e4@)g(x) dz, then the method of steepest descents may be 
used (see page 229). 

(B) f, ef (=) g(x) dx, where f(x) is a real function, then Laplace’s 
method may be used (see page 221). 

(C) fo e*4@)9(x) dx, where f(x) is a real function, then the method 
of stationary phase may be used (see page 226). 

There is a collection of other special forms on page 181. 

Interval analysis techniques, whether implemented analytically or nu- 

merically, permit exact upper and lower bounds to be determined for 

an integral (see page 218). 
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Looking for a Numerical Evaluation 


[1] 


[2] 
[3] 


[4] 
[5] 


[6] 


[7] 
[8] 


It is often easiest to use commercial software packages when looking 
for a numerical solution (see page 254). The type of routine needed 
may be determined from the taxonomy section (see page 258). The 
taxonomy classification may then be used as the entry in the table of 
software starting on page 260. 

If a low accuracy solution is acceptable, then a Monte Carlo solution 
technique may be used, see page 304. 

If the integral in question has a very high dimension, then Monte Carlo 
methods may be the only usable technique, see page 304. 

If a parallel computer is available to you, then see page 315. 

If the integrand is periodic, then lattice rules may be appropriate. See 
page 300. 

References for quadrature rules involving specific geometric regions, 
or for integrands with a specific functional form, may be found on 
page 337. 

Examples of some one-dimensional and two-dimensional quadratures 
rules may be found on page 340. 

A listing of some integrals that have been tabulated in the literature 
may be found on page 348. 


Other Things to Consider 


[1] 
[2] 


[3] 


Is fractional integration involved? See page 75. 

Is a proof that the integral cannot be evaluated in terms of elementary 
functions desired? See page 77. 

Does the equation involve a large or small parameter? See the asymp- 
totic methods described on pages 195 and 199. 


Applications of 
Integration 


1. Differential Equations: 
Integral Representations 


Applicable to Linear differential equations. 
Idea 

Sometimes the solution of a linear ordinary differential equation can 
be written as a contour integral. 


Procedure 
Let L,[-] be a linear differential operator with respect to z, and suppose 
that the ordinary differential equation we wish to solve has the form 


L,[u(z)] = 0. (1.1) 
We look for a solution of (1.1) in the form of an integral 
u(z) =f K(2,€)o(@) ae (1.2) 


1 
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for some function v(€) and some contour C in the complex é plane. The 
function K(z,€) is called the kernel. Some common kernels are: 


Euler kernel: K(z,€) = (z -— €)” 
Laplace kernel:  K(z,€) = e§? 
Mellin kernel: K(z,é) = 26 


We combine (1.2) and (1.1) for 
[ bat a.) dg = 0. (1.3) 


Now we must (conceptually) find a linear differential operator A¢|[-], oper- 
ating with respect to é, such that L,[K(z,€)] = Ag[K(z,€)]. After Ag[-] 
has been found, then (1.3) can be rewritten as 


[ Acti, o)o(@) ag = 0 (1.4) 
Now we integrate (1.4) by parts. The resulting expression will be a dif- 
ferential equation to be solved for v(€) and some boundary terms. The 


boundary terms will determine the contour C. Knowing both v(€) and C, 
the solution to (1.1) is given by the integral in (1.2). 


Example 
Consider Airy’s differential equation 


L,{u] = u"(z) — zu(z) = 0. (1.5) 
We assume that the solution of (1.5) has the form 
u(z) = [etue dé, (1.6) 
for some v(£) and some contour C. Substituting (1.6) into (1.5) we find 
i} Cu(ee* dé — 2 ‘: v(O)e% dé = 0. (1.7) 


The second term in (1.7) can be integrated by parts to obtain 


[ eroterers ae — [o(eyer 


! 2€ = 
+ [@5 d& = 0, 


or 


[peer 


: + [et levee +1 dé = 0. (1.8) 
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Figure 1. A solution to (1.5) is determined by any contour C that starts and 
ends in the shaded regions. All of the shaded regions extend to infinity. One 
possible contour is shown. 


We choose 
Ag[v] = €?u(€) + v'(€) = 0, (1.9) 


and the boundary conditions 


= 0. (1.10) 
c 


ener 


With these choices, equation (1.8) is satisfied. From (1.9) we can solve for 


u(g): 
3 
v(€) = e(-5) . (1.11) 


Using (1.11) in (1.10) we must choose the contour C so that 


7 : e) 
, | exe( ze 3 


for all real values of z. The only restriction that (1.12) places on C is that 
the contour start and end in one of the shaded regions shown in Figure 1. 
Finally, the solution to (1.5) can be written as the integral 


= 0, (1.12) 
Cc 


cede 


u(z) = [ e(§2-€7/3) ae, (1.13) 


Asymptotic methods can be applied to (1.13) to determine information 
about u(z). 
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Notes 


[1] 
[2] 


[3] 


[4] 


[5] 


This method is also known as Laplace’s method. 
Loop integrals are contour integrals in which the path of integration is given 
by a loop. For example, the integral | am, indicates an integral that starts 
at negative infinity, loops around the origin once, in the clockwise sense, and 
then returns to negative infinity. 

Using the methods is this section, the fundamental solutions to Le- 
gendre’s differential equation, (1 — 2”)y” — 2zy’ + n(n + 1)y = 0, can be 
written in the form of loop integrals: 


(1+,2+) 2 ayy 


nt 2°(z—¢)’t? 
(1t+,-14+) 7,2 v (1.14.a-6) 
Q.(z) = aah AG = 1)e d¢ 
i 4isinvar 2"(2z-¢)"*" 


where the integration contour in (1.14.a) is a closed curve with positive 
direction passing through the ¢-plane, avoiding the half-line (—oo, —1), and 
admitting 1 and z as inner points of the domain it bounds. The contour 
in (1.14.b) is a closed oo-shaped curve encircling the point 1 once in the 
negative direction and the point —1 once in the positive direction. Equation 
(1.14.a) is known as Schlafli’s integral representation. 

Since there are three regions in Figure 1, there are three different contours 
that can start and end in one of these regions; each corresponds to a solution 
of (1.5). The functions Ai(z) and Bi(x), appropriately scaled, are obtained 
by two of these three choices for the contour (see page 171). The third 
solution is a linear combination of the functions Ai(z) and Bi(z). 
Sometimes a double integral may be required to find an integral represen- 
tation. In this case, a solution of the form u(z) = ff K(z;s,t)w(s, t) ds dt is 
proposed. Details may be found in Ince [8], page 197. As an example, the 
equation 


2 
(x? — 1) 28 + (0464 1)0% + aby =0 
dx” dx 


has the two linearly independent solutions 
oo oo 1 
y+(r) = i | exp [est - 50s + t?)| 3°14?! ds dt. 
o Jo 


Poisson’s integral formula is an integral representation of the solution to 
Laplace’s differential equation. If u(r,@) satisfies Laplace’s equation V7u = 
Urr +7 ‘Ur +7 ues = 0 for 0 <r < R, and u(R, 6) = f(8) for 0 < 0 < 2z, 
then u(r, 0) for 0 <r < R is given by 


r2 


1 f" R? - 


This is known as the Poisson formula for a circle. Integral solutions for 
Laplace’s equation are also known when the geometry is a sphere, a half- 
plane, a half-space, or an annulus. See Zwillinger [10] for details. 


[7] 
(8) 


[9] 


[10] 
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Pfaffian differential equations, which are equations of the form 


ir (ed) +0(ed)]ve0 


can also be solved by this method. See Zwillinger [10]. 
An application of this method to partial differential equations may be found 
in Bateman [2], pages 268-275. 
The Mellin—Barnes integral representation for an ordinary differential equa- 
tion has the form 
(2) = / v(é)z | jai? Os ~ 6) Hash G = ay +6) 

Cc aeey (1 _ b; ae é) 0 ae (a; > E) 
In this representation, only the contour C and the constants {a;:, bj, m,n, q,r} 
are to be determined (see Babister [1] for details). 
The ordinary integral sb A(t) dt is a construction that solves the initial- 
value problem: y’(rz) = A(x) with y(zo) = O (here O is the matrix of 
all zeros). The product integral is an analogous construction that solves 
the initial-value problem: y‘(z) = A(x)y(zx) with y(zo) = J (here J is the 
identity matrix). See Dollard and Friedman [6] for details. 
Given a linear differential equation (ordinary or partial): L[u] = f(x), the 
Green’s function G(x, z) satisfies L[G] = 6(x—z), and a few technical condi- 
tions. (Here, 6 represents the usual delta function.) The solution to the orig- 
inal equation can then be written as the integral u(x) = f f(z)G(x, z) dz. 
See Zwillinger (10] for details. 
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6 I Applications of Integration 


Zz. Differential Equations: 
Integral Transforms 


Applicable to Linear differential equations. 


Idea 

In order to solve a linear differential equation, it is sometimes easier to 
transform the equation to some “space,” solve the equation in that “space,” 
and then transform the solution back. 


Procedure 

Given a linear differential equation, multiply the equation by a kernel 
and integrate over a specified region (see Table 2.1 and Table 2.2 for a 
listing of common kernels and limits of integration). Use integration by 
parts to obtain an equation for the transform of the dependent variable. 

You will have used the “correct” transform (i.e., you have chosen the 
correct kernel and limits) if the boundary conditions given with the original 
equation have been utilized. Now solve the equation for the transform of 
the dependent variable. From this, obtain the solution by multiplying by 
the inverse kernel and performing another integration. Table 2.1 and Table 
2.2 also list the inverse kernel. 


Example 
Suppose we have the boundary value problem for y = y(x) 
Yer ty = 1, 
y(0)=0, y(1)=0. 
Since the solution vanishes at both of the endpoints, we suspect that a 


finite sine transform might be a useful transform to try. Define the finite 
sine transform of y(z) to be z(£), so that 


(2.1.a-c) 


1 
2(€) =| y(x) sin Ex dz. (2.2) 


(See “finite sine transform-2” in Table 2.1). Now multiply equation (2.1.a) 
by sin €z and integrate with respect to x from 0 to 1. This results in 


1 1 1 
[ Yer (x) sin Ex dz + / y(z) sin x dz = / sin €z dz. (2.3) 
0 0 0 


If we integrate the first term in (2.3) by parts, twice, we obtain 
z=1 z=1 


— €y(x) cos x 


z=0 


1 
i Yeu(x) sin €x dz = y,(x) sin x 
° cia (2.4) 


1 
— ¢? i y(x) sin Ez dz. 
0 
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Since we will only use € = 0,7,27,... (see Table 2.1), the first term on 
the right-hand side of (2.4) is identically zero. Because of the boundary 
conditions in (2.1.b-c), the second term on the right-hand side of (2.4) also 
vanishes. (Since we have used the given boundary conditions to simplify 
certain terms appearing in the transformed equation, we suspect we have 
used an appropriate transform. If we had taken a finite cosine transform, 
instead of the one that we did, the boundary terms from the integration 
by parts would not have vanished.) 
Using (2.4), simplified, in (2.3) results in 


: : ; 1 — cos& 
2 . 
—€ / y(x) sin €x dr +f y(x) sin x dx = ————. 


Using the definition of z(€) (from (2.2)) this becomes 


~€72(£) + 2(é) = Ss 
or 1 F 
~—- COs 
HO= Gree 


Now that we have found an explicit formula for the transformed function, 
we can use the summation formula (inverse transform) in Table 2.1 to 


determine that 
y(z)= > 2z(€)sin€s, 
€=0,7,27,... 


= > ery. 


€=0,7,2r,. me! = CE 


sin Ez, 


= 2G nae yak ; sinkrz, 
_ é 4sinkaz 
or (1 —17k?)ak’ 


k=1,3,5,... 
where we have defined k = €/7. 
1 


1 
The exact solution of (2.1) is y(x) = 1—cosz+ —— sin x. If this 


solution is expanded in a finite Fourier series, we obtain the representation 
in (2.5). 


8 I Applications of Integration 


Table 2.1 Different transform pairs of the form 


B 
o(€)= f uleyK (e.g) ae, ule) = SO He ee n(G) 


gk 


Finite cosine transform -— 1, (see Miles [17], page 86) here J and hare arbitrary, 
and the {&,} satisfy €, tané,/ =h 


1 = 2, 22 
v(&%) = i u(x) cos(z&) dz, u(r) = > alee 
. & 


Finite cosine transform — 2, (see Butkov [3], page 161) this is the last 
transform with h = 0, 1 = 1, so that €, = 0,7,27,.... 


v(é.) = i u(a) cos (xx) dz, u(x) = S>(2 ~ 6,0) cos (Ex) v(Et). 


& 


Finite sine transform — 1, (see Miles (17], page 86) here / and h are arbitrary, 
and the {&,} satisfy &, cot(.l) = —h. 


2 +h?) sin (€,2) 


{ 
v(€,) = i u(x) sin(r&,) dz, u(x) = yoo +12 +h?) u(x). 
&k 


Finite sine transform — 2, (see Butkov [3], page 161) this is the last transform 
with h = 0,1 = 1, so that ££ =0,7,27,.... 


u(é.) = iE u(x) sin(ré,) dz, u(r) = Ss. 2sin (€,2) v(é,). 


& 


Finite Hankel transform — 1, (see Tranter [24], page 88) here n is arbitrary 
and the {&,} are positive and satisfy Jn(&,) = 0. 


1 
HG) = [wla)edn(ety de, ule) = Doge lea) 


Finite Hankel transform — 2, (see Miles {17], page 86) here n and h are 
arbitrary and the {€,} are positive and satisfy &J;,(a&%) + hJn(a&) = 0. 


w(G) = [ w(adesn(ets) de, u(s) = > eee 
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Finite Hankel transform — 3, (see Miles [17], page 86) here 6 > a, the 
{&.} are positive and satisfy Y,(aé%)Jn (bE) = Jn(aéx)Yn (bx), and Zn(x&,) = 
Yn(a€k)In(rée) — In(a€s)¥n(2Ee). 


: 2 22 72 
de [nents EEO 
. &k " 


Legendre transform, (see Miles [17], page 86) here &, = 0,1,2,... 


ont 


ug) =f ula)Pe(a)ae, ula) = yt *P,, utes, 


&& 


Table 2.2 Different integral transform pairs of the form 


B b 
v(é) = il K(x,é)u(z)de, — u(z) = / H(a, €)u(€) dé. 


Fourier transform, (see Butkov [16], Chapter 7) 


6) = / fF u(c)de, (2) = 2 / eo *8 u(€) ae. 


Fourier cosine transform, (see Butkov [16], page 274) 


w=? i cos(xé) u(z) dr, u(a)= 2 i cos(xé) u(€) dé. 
0 


Fourier sine transform, (see Butkov [16], page 274) 


v(€) = y2 i sin(2é) u(z) dz, u(z) = /2 i, sin(xé) v(€) dé. 


Hankel transform, (see Sneddon (20}, Chapter 5) 


v(é) = / u()eJ(xt)de, u(z) = [ é Ju(wé)u(€) de. 
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Hartley transform, (see Bracewell [5}) 
v(€) = = a (cos € + sinz€) u(x) dz, 


u(z) = = is (cos 2€ + sin z&) u(€) dé. 


Hilbert transform, (see Sneddon [20], pages 233-238) 


u(é) =f ue) dz, u(z) =f Se dé. 


K-transform, (see Bateman [3]) 


(~s) o+to0o 
oe)= f° Kulat)Veeule)de, u(e)= 2 [Ieee Ec v(e) ae 
0 a—1t00 


Kontorovich—Lebedev transform, (see Sneddon (20], Chapter 6) 
oe) = [BO wards, wa) = 3 | esinnine Kila) v6) a6 
Kontorovich—Lebedev transform (alternative form), (see Jones [14]) 
w= [HP e)uerde, we)=-Z [ exteyveyae 


Laplace transform, (see Sneddon [20], Chapter 3) 


ot+t 


o(6) = i "e-u(z)de, ule)=n fe u(é)ae. 


ni o—i00 
Mehler—Fock transform of order m, (see Sneddon [20], Chapter 7) 
oo 
u(é) = i sinh(z)Pi¢_1/2(cosh z) u(z) dz, 
0 


ue) = [ granh(ng)PE-1pa(cosh =) (6) a. 
0 


Mellin transform, (see Sneddon (20], Chapter 4) 


ot+too 


w= [af ule)de, ula) = [af oleae 


—too 


2. 
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Weber formula, (see Titchmarsh [23], page 75) 


v(é) = | ” Vi [Ju €)¥L(a€) — ¥.(2€)J.(a€)] u(x) de, 


= © Ju(zé)¥L(aé) — ¥.(x€) JL (a€) 
ue) = ve | T2(aé)+¥2(aéy —e) % 


Weierstrass transform, (see Hirschman and Widder [11], Chapter 8) 


0° T 
w= fk ufe) de, ala) = Ze tim [ee uc a. 
—0o —-T 


Notes 


[1] 


[2] 
[3] 


[4] 


[5] 


[6] 
[7] 


[3] 


There are many tables of transforms available (see Bateman [3] or Magnus, 
Oberhettinger, and Soni [16]). It is generally easier to look up a transform 
than to compute it. 

Transform techniques may also be used with systems of linear equations. 
Transforms may also be evaluated numerically. There are many results on 
how to compute the more popular transforms numerically, like the Laplace 
transform. See, for example, Strain [22]. 

The finite Hankel transforms are useful for differential equations that contain 
the operator Lxy[u] and the Legendre transform is useful for differential 
equations that contain the operator Lz[u], where 


Lulu] =ure+— pu and Lily] = 5 @ tie a) 


For example, the Legendre transform of Lz[u] is simply —&(€% + 1)v(€x). 
Integral transforms are generally created for solving a specific differential 
equation with a specific class of boundary conditions. The Mathieu inte- 
gral transform (see Inayat-Hussain [12]) has been constructed for the two- 
dimensional Helmholtz equation in elliptic-cylinder coordinates. 

Integral transforms can also be constructed by integrating the Green’s func- 
tion for a Sturm-—Liouville eigenvalue problem. See Zwillinger [25] for details. 
Note that many of the transforms in Table 2.1 and Table 2.2 do not have a 
standard form. In the Fourier transform, for example, the two /2z terms 
might not be symmetrically placed as we have shown them. Also, a small 
variation of the K-transform is known as the Meijer transform (see Ditkin 
and Prudnikov [8], page 75). 

If a function f(x,y) has radial symmetry, then a Fourier transform in both 
z and y is equivalent to a Hankel transform of f(r) = f(z,y), where r? = 
x? +y”. See Sneddon [20], pages 79-83. 
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[9] 


[10] 


[11] 


[12] 


I Applications of Integration 


Two transform pairs that are continuous in one variable and discrete in the 
other variable, on an infinite interval, are the Hermite transform 


co 


ula) =D oonHa(ae?, mm = oe I  ule)Ha(a)en*? de, 


n=0 
where H,(z) is the n-th Hermite polynomial, and the Laguerre transform 


co 


u(z) = S> nLa(z) 


n=0 


t co 

Fane) 75 1)’ Un = [ u(x) Le (x)2%e~* dz, 
where Li(x) is the Laguerre polynomial of degree n, and a > 0. See 
Haimo [10] for details. 

Classically, the Fourier transform of a function only exists if the function 
being transformed decays quickly enough at +oo. The Fourier transform 
can be extended, though, to handle generalized functions. For example, the 
Fourier transform of the n-th derivative of the delta function is given by 
F (6™(¢)] = (iw)”. 

Another way to approach the Fourier transform of functions that do 
not decay quickly enough at either oo or —oo is to use the one-sided Fourier 
transforms. See Chester [6] for details. 

Many of the transforms listed generalize naturally to n dimensions. For 
example, in n dimensions we have: 


v(€) = (2n)-"/? / e® Xu(x) dx, 

(A) Fourier transform: R" 

u(x) = (2n)-"/? / eB Xy(€) dé. 
R"” 


(B) Hilbert transform (see Bitsadze [4]): 


Of =) I\(n/2) Yi- Ti . = 
Ox; = nn? er ly — x|" o(y) dy, t= 1,2,...,7 1, 
D'(n/2) (y —x)- Vf 
=-> a dy. 
o(y) i fa. wor 


Apelblat [2] has found that repeated use of integral transforms can lead to 
the simplification of some infinite integrals. For example, let F(y) denote 
the Fourier sine transform of the function f(x), Fs(y) = { Pag f(x) sin yz dz. 
Taking the Laplace transform of this results in 


G(s) = Te: en if f(a)sinye de} dy 


=f as, 
0 


2 
8S +2 


(2.6) 


where the order of integration has been changed and then the inner integral 
evaluated. For some functions f(z) it may be possible to find the corre- 
sponding F;(y) and G(s) using comprehensive tables of integral transforms. 


[13] 


[14] 


[15] 
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Equating this to the expression in (2.6) may result in a definite integral hard 
to evaluate in other ways. 

1 
z(a? +27) 
With this we can find F.(y) = 35 (1 - e*v) . Taking the Laplace transform 
of this, and equating the result to (2.6), we have found the integral 


As asimple example of the technique, consider using f(x) = 


oo 
dz = T 
[ (a? + z*)(s” +27) 2as(a+s) 


Carson’s integral is the integral transformation 2(p) = p 1 Bg e—?* f(t) dt. See 
Iyanaga and Kawada [8]. 

A transform pair that is continuous in each variable, on a finite interval, is 
the finite Hilbert transform 


1 1 = 
WO= Tf eget we) = is c -3f wo “| | 


where C' is an arbitrary constant, and the integrals are principal value 
integrals. See Sneddon [20], page 467, for details. 

Note that, for the Hilbert transform, the integrals in Table 2.2 are principal 
value integrals. 


References 


[1] 
[2] 


[3] 
(4] 
[5] 
[6] 
[7] 
[8] 


[9] 
[10] 


[11] 


M. Abramowitz and I. A. Stegun, Handbook of Mathematical Functions, 
National Bureau of Standards, Washington, DC, 1964, pages 1019-1030. 
A. Apelblat, “Repeating Use of Integral Transforms—A New Method for 
Evaluation of Some Infinite Integrals,” IMA J. Appl. Mathematics, 27, 1981, 
pages 481-496. 

Staff of the Bateman Manuscript Project, A. Erdélyi (ed.), Tables of Integral 
Transforms, in 3 volumes, McGraw-Hill Book Company, New York, 1954. 
A. V. Bitsadze, “The Multidimensional Hilbert Transform,” Soviet Math. 
Dokl., 35, No. 2, 1987, pages 390-392. 

R. N. Bracewell, The Hartley Transform, Oxford University Press, New 
York, 1986. 

C. R. Chester, Techniques in Partial Differential Equations, McGraw-Hill 
Book Company, New York, 1970. 

B. Davies, Integral Transforms and Their Applications — Second Edition, 
Springer-Verlag, New York, 1985. 

V. A. Ditkin and A. P. Prudnikov, Integral Transforms and Operational 
Calculus, translated by D. E. Brown, English translation edited by I. N. 
Sneddon, Pergamon Press, New York, 1965. 

H.-J. Glaeske, “Operational Properties of a Generalized Hermite Transfor- 
mation,” Aeguationes Mathematicae, 32, 1987, pages 155-170. 

D. T. Haimo, “The Dual Weierstrass-Laguerre Transform,” Trans. AMS, 
290, No. 2, August 1985, pages 597-613. 

I. I. Hirschman and D. V. Widder, The Convolution Transform, Princeton 
University Press, Princeton, NJ, 1955. 


14 
[12] 
[13] 
[14] 


[15] 
[16] 


[17] 


[18] 
[19] 


[20] 
[21] 
[22] 
[23] 
[24] 


[25] 


3. 


I Applications of Integration 


A. A. Inayat-Hussain, “Mathieu Integral Transforms,” J. Math. Physics, 32, 
No. 3, March 1991, pages 669-675. 

S. lyanaga and Y. Kawada, Encyclopedic Dictionary of Mathematics, MIT 
Press, Cambridge, MA, 1980. 

D. S. Jones, “The Kontorovich-Lebedev Transform,” J. Inst. Maths. Ap- 
plics, 26, 1980, pages 133-141. 

O. I. Marichev, Handbook of Integral Transforms of Higher Transcendental 
Functions: Theory and Algorithmic Tables, translated by L. W. Longdon, 
Halstead Press, John Wiley & Sons, New York, 1983. 

W. Magnus, F. Oberhettinger, and R. P. Soni, Formulas and Theorems for 
the Special Functions of Mathematical Physics, Springer-Verlag, New York, 
1966. 

J. W. Miles, Integral Transforms in Applied Mathematics, Cambridge Uni- 
versity Press, 1971. 

C. Nasim, “The Mehler-Fock Transform of General Order and Arbitrary 
Index and Its Inversion,” Int. J. Math. & Math. Sct., 7, No. 1, 1984, pages 
171-180. 

F. Oberhettinger and T. P. Higgins, Tables of Lebedev, Mehler, and Gen- 
eralized Mehler Transforms, Mathematical Note No. 246, Boeing Scientific 
Research Laboratories, October 1961. 

I. N. Sneddon, The Use of Integral Transforms, McGraw-Hill Book Com- 
pany, New York, 1972. 

I. Stakgold, Green’s Functions and Boundary Value Problems, John Wiley 
& Sons, New York, 1979. 

J. Strain, “A Fast Laplace Transform Based on Laguerre Functions,” Math. 
of Comp., 58, No. 197, January 1992, pages 275-283. 

E. C. Titchmarsh, Eigenfunction Expansions Associated with Second-Order 
Differential Equations, Clarendon Press, Oxford, 1946. 

C. J. Tranter, Integral Transforms in Mathematical Physics, Methuen & Co. 
Ltd., London, 1966. 

D. Zwillinger, Handbook of Differential Equations, Academic Press, New 
York, Second Edition, 1992. 


Extremal Problems 


Applicable to _‘ Finding a function that maximizes (or minimizes) an 
integral. 


Yields 


A differential equation for the critical function. 
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Procedure 
Given the functional 


Fiu)= / / L(x, Oz, )u(x) dx, (3.1) 
R 


where the operator L() is a linear or nonlinear function of its arguments, 
how can u(x) be determined so that J[u] is critical (i.e., either a maximum 
or a minimum)? 

The variational principle that is most often used is 6J = 0, which 
states that the integral J[u] should be stationary with respect to small 
changes in u(x). If we let h(x) be a “small,” continuously differentiable 
function, then we can form 


J(ut+th]—J[u] = i/ ce Oz, )(u(x) + A(x)) — L(x, az, u(x) dx. (3.2) 
R 


By integration by parts, (3.2) can often be written as 


Jiu + A} — Ju] = / N(x, dp, )u(x) dx + O(|lAl|?) 
R 


plus some boundary terms. The variational principle requires that 6J := 
J[u +h] — J[u] vanishes to leading order, or that 


N(x, Oz, u(x) = 0. (3.3) 


Equation (3.3) is called the first variation of (3.1), or the Euler-Lagrange 
equation corresponding to (3.1). (This is also called the Euler equation.) 
A functional in the form of (3.1) determines an Euler-Lagrange equation. 
Conversely, given an Euler-Lagrange equation, a corresponding functional 
can sometimes be obtained. 

Many approximate and numerical techniques for differential equations 
utilize the functional associated with a given system of Euler-Lagrange 
equations. For example, both the Rayleigh—-Ritz method and the finite 
element method create (in principle) integrals that are then analyzed (see 
Zwillinger [5]). 

The following collection of examples assume that the dependent vari- 
able in the given differential equation has natural boundary conditions. If 
the dependent variable did not have these specific boundary conditions, 
then the boundary terms that were discarded in going from (3.2) to (3.3) 
would have to be satisfied in addition to the Euler-Lagrange equation. 
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Example 1 
Suppose that we have the functional J[y] = J, F (z,y,y',y") dx. Form- 
ing (3.2) we find 


Jfu + h] - J fu] = iA Re uth +hiu" +h") — F(z, u,v’, u')| ae 
7 [ (Fe) + Fy(e)h + Fy(e)h! + Fyn(0)h” +O (%?)) 
: Fe) | dx 
= [ \Fu(e)h + Fy(e)h! + Fyo(s)h| dz +O (h’), 
(3.4) 


where the bullet stands for (x, u, u’, u’”), and the O (h?) terms should really 
be written as O (h?, (h’)?, (h’’)). Now integration by parts can be used to 


find 
d 
[rege 


d 
[8a 


ml, (oa + [re ) 
dz +] AR R dx yor 


y Fy(e)h' dz = Fy(e)h}  - 
R oR 


| Fyn (e)h” dx — Fyn (e)h’ _ 
R OR 


= Fyn (e)h' 
OR 


If we take the natural boundary conditions F,(e) 
dR 
0, then (3.4) becomes 


= 0 and Fy (e) 
OR 


Ju +h) — Ju] = : \Fu(e)h a “Fy ()h+ iatvon dx +0 (h?) 
= [|r Zee) + Sane] do +0 (0). 


(3.5) 
If (3.5) is to vanish for all “small” functions h, then it must be that 


F,(e) - “Fy (0) +S or yt(e) = 


This is the Euler-Lagrange equation associated with the original functional. 
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Example 2 
The Euler-Lagrange equation for the functional 


J[y] = fF (gales y)) dz, 


where y = (2) is 


OF d (OF\, @ (0F a” ( OF 
By as (ap) tat (ar) + ae (Ges) = 


For this equation the natural boundary conditions are given by 


y(zo) = Yo; y' (zo) = Yo eee y yr") (x0) = yr), 
y(21) = V1; y' (21) = Yi» les y—-Y) (21) ms yr), 
Example 3 


The Euler-Lagrange equation for the functional 


J[u] = i) F(z, Y, U, Ug, Uy, Ure, Usy, Uyy) dz dy, (3.6) 
R 


where u = u(z, y) is 


Example 4 
The Buler-Lagrange equation for the functional 


au) = f | f (Ft) +0 ($E) +o ay| dz dy, 
R 


which is a special case of (3.6), is - (. x) + s (> x) —cu=f. 
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Example 5 
For the 2m-th order ordinary differential equation (in formally self- 
adjoint form) 


— dé d*u 
So(-1r (Pe(e) ge) =) 
u(a) = u'(a) = ++» = ul (a) = 0, 
u(b) = u'(b) =--- = ul™-(b) = 0, 


a corresponding functional is 


b fm k,.\ 2 
stu) = | (Smt (=) ~2f(e)t)] dz. 
a \k=0 


Notes 

[1] Note that two different functionals can yield the same set of Euler-Lagrange 
equations. For example, 6 f Jdz =6 f (J +y+ xy’) dx. The reason that 
6 f (y+ zy’) dx = 0 is because the integrand is an exact differential ( f (y+ 
ry’) dz = f d(xy)). Hence, this integral is path independent; its value is 
determined by the boundary conditions. 

The Euler-Lagrange equations for the two functionals f f uzrttyy dx dy 

and f f (uzy)* dz dy are also the same. 

[2] Even if the boundary conditions given with a differential equation are not 
natural, a variational principle may sometimes be found. Consider 


+ g2(z, u) 


t=T) 


? 


J[u] = Ee F(z,u,u') dz — gi(z,u) 


%1 


t=2XQ 


where gi(z,u) and go(z,u) are unspecified functions. The necessary condi- 
tions for u to minimize J[u] are (see Mitchell and Wait [3]) 


or 4 aF _, 
Gu dzdu ”’ 

OF | Ogi 0 OF | O92 0 

du’ ss Ou ine is du’ —s «Ou Exe x = 


If gi and ge are identically zero, then we recover the natural boundary 
conditions. However, we may choose gi and g2 to suit other boundary 
conditions. For example, the problem 


u’ + f(z) =0, 
u +au = 0, u' + Bu = 0, 
@r=7z, T=z22 
corresponds to the functional 
22 2 2 
2 1, 2 Bu au 
Je - [ E (u ) Fen] a ig 2 r=22 2 r=7) 
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[3] This technique can be used in higher dimensions. For example, consider the 

functional 

J(u] =) F(a, y,t, Uz, Uy, Ure, Ury, Uyy) dr dy 
R 
+/ G(qa, y, U, Ue, Uso, Un) do, 
oR 

where 0/00 and 0/@n are partial differential operators in the directions of 

the tangent and normal to the curve OR. Necessary conditions for J[u] to 

have a minimum are the Euler-Lagrange equations (given in (3.6)) together 

with the boundary conditions: 

ar _ 0 OF), (oF 8 oF), 
Our Oz Oucz Ouy Oy Otyy 
oO { OF OF 1/0 OF ;». 2 
E (= x) | Pelle eG E Ouzy (2. “| 
+ 1|( 9 OF oe Oo OF 
2|\ dz due, ) °°”  \ dy dus,” 
a0G , 0 OG 
Cu 56 Buc * Oa? Dee 
0G OF .. OF .. OF = 
Din Gua oun Pie 

where tg = dz/do and yo = dy/do. See Mitchell and Wait [3] for details. 
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4. Function Representation 


Idea 
Certain integrals can be used to represent functions. 


Procedure 
This section contains several different representational theorems. Each 
has found many important applications in the literature. 


Bochner—Martinelli Representation 


Let f be a holomorphic function in a domain D C C™, with 
piecewise smooth boundary OD, and let f be continuous in 
its closure D. Then we have the representation 


(n—1)! f — f(Q) f(z), ifzeD, 
(27i)” Ee ra ieee" 3 (65 - i) &; = e if z ¢ D, 


0, 


where dC; = dl, Add: A-++A[dC,]A-+- Ad, AdGn, and [dC,] 
means that the term dC; is to be omitted. 


For n = 1, this is identical to the Cauchy representation. Another way 
to write this result is as follows: 


Let H(G) be the ring of holomorphic functions in G. Let G; 
be a domain in the z;-plane with piecewise smooth boundary 
C;. If f € H(G) (where G := Wes G;) is continuous on G, 
then 


1 f(Q) UA... Adon = {5 for z € G, 


(2mt)" Joy x...%0_ (61 — 21) +++ (Cn - Zn) for z ¢G. 
For details see Krantz [5] or Iyanaga and Kawada [6] (page 101). 


Cauchy Representation 


Cauchy’s integral formula states that if a domain D is bounded by 
a finite union of simple closed curves I’, and f is analytic within D and 


across I’, then @) 
_1 f f@ 
H(6) = mi [eee 


for € € D. (See page 129 for several applications of this formula.) 
If D is the disk |z| < R, then Cauchy’s theorem becomes Poisson’s 
integral formula 


R? —r? 


7 1 2n ig 
FO= a5 fy TRO RET aR cose) 
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There is an analogous formula, called Villat’s integral formula, when D is 
an annulus. See Iyanaga and Kawada [6], page 636. 
There are also extensions of this cormula when f(z) is not analytic. 


In terms of the differential operator Og = 4 (0, + Oy), the Cauchy-Green 
formula is 
fs @) 1 4 Of 1 
D 


for € € D. This formula is valid whenever f is smooth enough for the 
derivative Oz to make sense. If f is analytic, then the Cauchy—-Riemann 
equations hold; these equations are equivalent to 6z = 0. See Khavinson [7] 
for details. 


Green’s Representation Theorems 
e Three dimensions: If ¢ and V7¢ are defined within a volume V bounded 
by a simple closed surface S, p is an interior point of V, and n 
represents the outward unit normal, then 


[ve 10$ 4¢_ 1 a (1 
$(p) = r ey + ak on 8-5. [ ts, (=) aS 

(4.1) 

Note that if ¢ is harmonic (i.e., V?¢ = 0), then the right-hand side of 

(4.1) simplifies. 

Two dimensions: If ¢ and V7¢ are defined within a planar region S 

bounded by a simple closed curve C, p is an interior point of S, and 

Ng represents the outward unit normal at the point q, then 


1 7) 
(p) = 5 rh V*4(a)log ip — ala8-+ 5 | da) go~ low — al da 


aie = ah log |p — a O(a) da 


n dimensions: If ¢ and its ee derivatives are defined within a 
region 2 in R” bounded by the surface L, and ng represents the 
outward unit normal at the point g, then for points p not on the 
surface © we have (if n > 3) 


[*, _V?9(q) 


~ (n—2)on Jp |p — al"? 


1 1 99(q) | 1 ) 2 
. (n —2)on [ (oe Ong oa #0 Bp. lp -— q\"~? . 


where o, = 27"/?/T'(n/2) is the area of a unit sphere in R”. 
See Gradshteyn and Ryzhik [2], 10.717, pages 1089-1090 for details. 


o(p) = 


qd 
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Herglotz’s Integral Representation 
The Herglotz integral representation is based on Poisson’s integral 
representation. It states: 


Let f(z) be holomorphic in |z| < R with positive real part. 


Then 
f(z) = ia nets +2 apd), 
0 


for |z| < R, where p(#) is a monotonic increasing real-valued 
function with total variation unity. This function is deter- 
mined uniquely, up to an additive constant, by f(z). 


See Iyanaga and Kawada [6], page 161. Another statement of this 
integral representation is (see Hazewinkel [3], page 124): 


Let f(z) be regular in the unit disk D = {z | |z| < 1}, and 
assume that it has a positive real part (i.e., Re f(z) < 0), 
then f(z) can be represented as 


se) = f #2 aye) + ic, 


where the imaginary part of c is zero. Here yp is a positive 
measure concentrated on the circle {€ | |€| = 1}. 


Parametric Representation of a Univalent Function 
From Hazewinkel [3], page 124, we have: 
Let f(z) be analytic in the unit disk D = {z | |z| < 1}, and 
assume that Im f(x) = 0 for —1 <  < landIm f(z)Imz >0 
for Imz # 0. Then f(z) can be represented as 
zd, 
f(z)= __2du(§) 
(z — €)(z - €) 
where pz is a measure concentrated on the circle {€ | |€| = 1} 
and normalized by ||y|| = f du(€) = 1. 


Pompeiu Formula 
From Henrici [4] we have the following theorem: 
Theorem: Let RA be a region bounded by a system I of 
regular closed curves such that points in R have winding 
number 1 with respect to I’. If f is a complex-valued function 
that is real-differentiable in a region containing RUT, then 
for any pom z € R there holds 


He)= 55 | ae | [ een, 


where ¢ = x + iy. 


Note that if f(z) is analytic, then this reduces to Cauchy’s formula. 
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Solutions to the Biharmonic Equation 


Some function representations require that the function have some 
specific properties. For example, if u is biharmonic in a bounded region R 
(that is, V4u = 0), and if f = Vu, then u(z) may be written as (for 
z€ R): 


u(z) = m | | f(t) es Fal =F dx dy + v(z) 


where t = xz + ty and v is harmonic in R (that is, v satisfies Laplace’s 
equation V7v = 0). See Henrici [4]. 


Notes 

[1} Schlafli’s integral representation is an integral representation of the Legendre 
function of the second kind. 

[2] See also the section on integrals used to represent the solutions of differential 
equations (page 1). 

[3] If a domain D is simply connected, and the vector field V tends suffi- 
ciently rapidly to zero near the boundary of D and at infinity, then we 
have Helmholtz’s theorem: V = V¢+ V x A, where 


0 [ae Ae) ae 


[4] If we define the one-form 


-1 _ ais oe 
w(C, z)= al eae d (6; _ Z;) d¢; 


then a generalization of the Bochner-Martinelli representation, which is 
analogous to the Cauchy-Green formula is given by (see Hazewinkel {3], 
page 404): 


If the function f is continuously differentiable in the closure 
of the domain D C C” with piecewise-smooth boundary 0D, 
then, for any point z € D, 


Oe | _ Sl )olGs2) ~ , BHC) Aw(C,2). 
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Geometric Applications 


Idea 


Integrals and integration have many uses in geometry. 


Length 


If a two-dimensional curve is parameterized by x(t) = (x(t), y(¢)) for 


a <t <b, then the length of the curve is given by 


For a curve defined by y = y(x), for a < x < }, this simplifies to 


b 2 
b= | 1+ (2) dz. 
‘ y dx 


A curve in three-dimensional space {z(t), y(t), z(t)}, fora < t < b, has 


length 
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Area 
If a surface is described by 


z=f(z,y), for (x,y) in the region Rz,y, 


then the area of the surface, S, is given by 


S= [I 1+ ($=) ) dea 


If, instead, the surface is described parametrically by x = (z,y,z) with 
= r(u,v), y = y(u,v), z = z(u,v), for (u,v) in the region Ry, then the 
area of the surface, S, is given by 


S= eke tide F? dudv, 


Ruv 


where St wen, 
EB=Xuy-Xu = 2+ yy t+ Za 


F= Xu Xy = Lyly + YuYu + Zu2v, (5.1) 
G=Xy-X%y = 224+ y2 + 22. 


General Coordinate Systems 

In a three-dimensional orthogonal coordinate system, let {a;} denote 
the unit vectors in each of the three coordinate directions, and let {u;} 
denote distance along each of these axes. The coordinate system may be 
designated by the metric coefficients {911,922,933}, defined by 


Oz, . 0x2 $ 023 
“= = 2 
Ji (=) as (= = Ou; ; (5 ) 
where {21, 22,23} represent rectangular coordinates. Then an element of 
area on the u ug surface (i.e., uz is held constant) is given by dS}. = 
[, /Firdus | ie /G22duU2). Metric coefficients for some common orthogonal co- 
ordinate systems may be found on page 113. Moon and Spencer [2] list the 


metric coefficients for 43 different orthogonal coordinate systems. (These 
consist of 11 general systems, 21 cylindrical systems, and 11 rotational 


systems. ) 
Operations for orthogonal coordinate systems are sometimes written 
in terms of {h,;} functions, instead of the {g;;} terms. Here, h; = /gi, so 


that, for example, dS. = [hidu;] [hedue]. 
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Volume 
Using the metric coefficients defined in (5.2), we define g = 911922933. 
An element of volume is then given by 


= 4/911922933 du; duz dug = \/g du; dup du3. 


Moments of Inertia 
For a bounded set S with positive area A and a density function p(z, y), 

we have the following definitions: 

J, [ e(z,y) dA = M = total mass 

f f o(z, a dA = M, = first moment with respect to the z-axis 

if J e(z,y)ydA = Mo = = first moment with respect to the y-axis 

ff f e(a, ‘ dA = I, = second moment with respect to the y-axis 

f f e(z,y)y? aa = je = second moment with respect to the z-axis 

f J e(z,y) (2? + y*)dA = Ip = polar second moment with respect to the 
origin. 


Example 1 
Consider a helix defined by x(t) = (a cost, asint, bt) for t in the range 
(0, 27]. The length of this curve is 


2m 27 
b= | VoP sin? + a? cost t + Pat = [ V a2 + b? dt = 27vV/ a2 + b?. 
0 0 


Example 2 

Consider a torus defined by x = ((b + asin @) cos 6, (b+ asin dg) sin 8, 
acos@), where 0 < @ < 2m and 0 < ¢ < 27. From (5.1), we can compute 
E = x9- xg = (b+ asing)?, F = xg-xg = 0, and G = xg- xg = a?. 
Therefore, the surface area of the torus is 


2x p2r 2a 
5 = i} [ VEG — F2 d6d¢ = [fra a(b + asin ¢) d@ dé = 4n7ab. 


Example 3 

In cylindrical coordinates we have {11 = rcos¢, t2 = rsin¢, x3 = z} 
so that {h, = 1, hg = r, hz = 1}. Consider a cylinder of radius R and 
height H. This cylinder has three possible areas we can determine: 


H p2n H p2n 
Se: = il dSo: = / heh, dO dz = 2nRH, 
0 Q 0 0 


R pdx R p2r 
= / | dSo, = / hph, dO dr = 1R?, 
0 0 0 0 
H ,pR H ,pR 
= i: 7 doe / [ h,h, dr dz = RH. 
0 0 0 0 


5. 
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We can identify each of these: Sg, is the area of the outside of the cylinder, 
Ser is the area of an end of the cylinder, and S,, is the area of a radial 
slice (that is, a vertical cross-section from the center of the cylinder). 


We can also compute the volume of this cylinder to be 


H R 2a H R 2a 
V= | | | heh,h, dO dr dz = [ [ / rd dr dz = wR7H. 
o Jo Jo o Jo Jo 


Notes 


[1] 


[2] 


[3] 


If C is a simple closed curve, positively oriented, that is piecewise continuous, 
then the line integrals $, x dy and — ¢, y dz both have the same value, which 
is equal to the area enclosed by C. This is an application of Green’s theorem, 
see page 164. 

The quadratic form (see (5.1)) I = dx - dx = Edu? + 2F dudu + Gdv’ 
is called the first fundamental form of x = x(u,v). The length of a curve 
described by x(u(t), v(t)), for ¢ in the range (a, 8] is 


The Gauss—Bonnet formula relates the exterior angles of an object with the 
curvature of an object (see Lipschutz [2]): 


Let C be a curvilinear polygon of class C? on a patch of a 
surface of class greater than or equal to 3. We presume that 
C has a positive orientation and that its interior on the patch 
is simple connected. Then 


[vsas+ | [ xas=2- 6;, 
Cc : 
R 2 


where Kg is the geodesic curvature along C, K is the Gaussian 
curvature, R is the union of C and its interior, and the {6;} 
are the exterior angles on C. 


For example, consider a geodesic triangle formed from three geodesics. 
Along a geodesic we have ky = 0, so that 50,0; = 2m — f f Kds. Fora 


planar surface K = 0. Hence, we have found that the Simm of the exterior 
angles in a planar triangle is 27. (This is equivalent to the usual conclusion 
that the sum of the interior angles of a planar triangle is 7.) 

For a sphere of radius a, we have K = 1/a?. Therefore, the sum of the 
exterior angles on a spherical triangle of area A is 2x — A/a?. 
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6. MIT Integration Bee 


Every year at the Massachusetts Institute of Technology (MIT) there 
is an “Integration Bee” open to undergraduates. This consists of an hour- 
long written exam, with the highest scorers going on to a verbal exam run 
like a Spelling Bee. It is claimed that completion of first semester calculus 
is adequate to evaluate all of the integrals. 


In 1991 the written exam was given on January 15 and consisted of 
the following forty integrals that had to be evaluated: 


(1) feo dz (2) [ine — cos 2x) dr 
dx 
sin? 2 cos? x ad 
(5) / esin? zgc0s? = da (6) / ot 
L cr+1 
rf dx (8) ent 
z+] V2? + 2a +2 
(9) [re sin x dz (10) feet dz 
oz 7x 
(11) / a a (12) / cae a dz 
secxz + tanzsing e*> +e” 
2 
1 /- —— inh s — 
( 3) | 1+ i+ 3s dx (14) J sans cosh x dx 
eae 
(15) [Rae as) [== x? ae 
cos? & — x? ra 


dz 
17 >? 18 d 
( [a ( iene es 


as) [= (20) | =—* — 


— 10x + 26 =r 26 
x +1, 
(21) /— 13 cos z (22) lS 
(1-4 4x) 1/2 
(23) /S-- aa (24) / e991 dy 
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(25) [ces + 1)x* dr (26) [cos 2x)(sin 6x) dx 

dx be 23 

2 
(29) [ vecz — sin x dz (30) [5 a dx 
x’ 
(31) [= dx (32) [ee dx 
x? dz 

(35) |< (36) [ tanztog | see dz 

‘ dz 
(37) / cos(sin x) cos x dz (38) / a4 


(39) | pee (40) i Viana dz. 
Vv 16 — e? 

On January 22, the top 11 scorers on the written exam participated in 
the Integration Bee. (These people had obtained between 26 and 35 correct 
answers to the above written exam.) The first few rounds were run with a 
fixed time in which to simplify a specific integral. The integrals, and the 
time allowed for each, were: 


e 1 minute for fsin™’ zdr 
zg? —2r+2 
x? +1 
sin? x cos” x 
“1+ cos2x 


2 minutes for f /2+2?,/zrdz (since five people in a row did not 
obtain the correct answer, this integral was discarded and the people 
who could not integrate it were not penalized), 


2 minutes for f dz, 


2 minutes for f 


3 


e 2 minutes for f[ cos 4x cos 2zr dz, 


y 
£ 


1 
e 2 minutes for [ dz. 


After these integrals, there were four finalists. The ranking of the 
finalists was achieved by four rounds of competitive integration (a pair was 
given the same integral; whoever obtained the correct answer first was the 
winner of that round). The integrals to be evaluated were 


e” (x — 2) cot x 
/ x id log(sin x) ss 


[vsecteds [vseca(ctans +2) dz. 
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The 1991 title of “Grand Integrator of MIT” was awarded to Chris 
Teixeira. The second and third place winners were Belle Yseng and Trac 
Tran. 


7. Probability 


Idea 
This section describes how integration is used in probability theory. 


Procedure 
If p(x) represents the density function of the random variable X then 
the expectation of the function g(X) is given by 


Elg(X)] = d p(x)g(x) de, 


where the range of integration is specified by the density function. Expec- 
tations of certain functions have special names and notations. For example, 


mean of X = p= mn = E[X], 
variance of X = Var(X) = o? = py = E[(X — »)”], 
n-th moment of X = yup = E[X"], 
n-th central moment of X = yi, = E[(X — »)"], 
characteristic function of X = ¢(t) = E [e*], 
generating function of X = (s) = E [s*]. 
The random variable X, with density function f(x), has the distri- 


bution function F(x) = J“, f(t) dt. The probability that X < «x is then 
given by F(z). 


Notes 

[1] The mean is sometimes called the “average.” The skewness is defined to be 
to be 43/0", and the excess is defined to be 4/o* — 3. 

[2] If the random variable X has the density function f(x), then the entropy of 
X is defined to be (see McEliece [3]) 


H(X) = —Bllog f(X)] = / ” f(a) log f(x) de. 


[3] If the random variable X, (for n = 1,2,...) has the distribution , (for 
n=1,2,...), respectively, and if 


jim / f(x) d&q(z) = / f(z) d®c0(2) 


for every continuous function f with compact support, then the sequence 
{®,} is said to converge in distribution to Xoo. 
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[4] For a continuous parameter random variable {X(t)}, we can also define 


mean of X = p(t) = E[X], 
variance of X = Var(t) = E[(X(t) — n(t))’), 
covariance of X = Cov(s,t) = E[(X(t) — p(t))(X(s) — u(s))], 
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8. Summations: Combinatorial 


Applicable to Evaluation of combinatorial sums. 


Procedure 

A combinatorial sum may sometimes be written as a summation over 
contour integrals. Interchanging the order of integration (when permitted), 
allows a different integral to be evaluated. Evaluating this new integral will 
then yield the desired sum. 

Finding the contour integral representation of the terms in the sum- 
mation may be aided by Table 8. 


Example 1 
Consider the sum 


n 
kK\ (nt+k 
- _a\k 
sutm) = (0) (3) 

where m is an integer. By use of Table 8 we make the identification 

* 1 (1+z)* 1 (1+y)"t* 
S,(m) = ¥-(-4)* a | ies Ere al et) ay, 

" x 2mi Jioj=p, 2" Qni Jiyl=p. 


If we choose p; and p2 appropriately (i.e., in this case we require |y|? > 
4(1+2)(1+y) in the integration), then we may move the summation inside 
the integrals and evaluate the sum on k to obtain 


1 (l+y)"y 
S,(m) = a | “ania oi ee: 
) = Gra? Sisto totem 2 + 4 +d + 2) 
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Table 8. Representations of combinatorial objects as contour integrals. Here, 
resF'(z) denotes the sum of the residues of F(z) at all poles within some region 
z 


centered about the origin. That is: resF(z) = = Si F(z) dz. 
z 


Binomial Coefficients (where 0 < p < 1): 


Mm) areata tayne tt =f (at ayta ae. 
n z Qri oo 


Multinomial Coefficients (where '(p) = {x = (41,..., 2x) | |x] = pi, 
O0<pi<1,i=1,...,k}): 


m grat Se 
= res (l+ay+---+ax)"2, 125?) 
11,712,...,Mk Dy LQ, LE 
xo, "eO? 
1 rs eer es 
(L+ait-:-+24)"2)") 2p"? - + 


(27i)* (pe) 


x a, *—* dry res dx x. 


Bernoulli numbers: B, = nires(e7 — 1)" 2-". 
x 
Euler numbers: En = nirescosh7}(r)z~"—!. 
z 
m" 
Power terms —- = res (e™*2~"~) 
n! x 


Since m is an integer, the integral with respect to s may be evaluated by 
the residue theorem to obtain 


(-1)™ / (l+y)"*™ 
Spn(m) = 4" -——— sme ty: 
2mi Siyl=p (y + 2)7*? 


Evaluating this last integral, by another application of the residue theorem, 
we obtain our final form for the summation 


Sp(m) = (-1)"4” & - S) 2n+1 


2m }/2n+1° 


This is one of the so-called Moriety identities. 
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Example 2 
Consider the summation 


manne EDGE. an 


where m, n, and p are non-negative integers. Using Table 8, it is easy to 
show that 


fo *) 
1 (1+21)™ ) (/ (1+ 22)” ) 
R(m,n,p) := y ——— dr ———— dz 
®) (2mi)° = af |z2|=p2 at , 


k=0 


(14 z5)™t"tP-* 
x ( i ——agngl AES 
lz3l=e3 v3 


The reason that the k summation can be extended to include large values 
of k is because there are no contributions from these values. By defining 


Sz = {x = (x1,22,23) | |zi| = |z2| = 2,|¢3| = 3}, this integral can be 
written as 
R(m, n,p) = ——G | (1+ 23)™t"t"(1 + 21)™(1 + 22)"2g"""! 
(27i)” Js, 


x (S20 +3) Hee)*| dx. 


=0 
If we introduce the new variables ¢; and ft and define the curve S; = 
{t = (t1,t2) | [ta| = |t2| = 45}, then this last three-dimensional integral and 
summation may be written as the following five-dimensional contour inte- 
gral: 


(1+ 23)?t) 23 


1 
R(m,n, p) = ——= Ax tt, 
(map) = Oras tee F(ti,21)f(t2,22)(2120(1 +23) Ite 


where f(a,b) := x3 — a(1+ 6)(1 +23). If this five-dimensional integral is 
evaluated with respect to 2), Z2, and #3, in that order, then we obtain 
1 


R(m, 7, Pp) = oar |, (1 = t;)7? (1 —_ hee he dt. 


Using Table 8, this two-dimensional integral is equal to 


R(mn,p) = (™P)(**P), (8.2) 


™m Tt 
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The final result, equations (8.1) and (8.2), can be evaluated for differ- 
ent choices of the parameters to obtain, for instance, 


See 3 @ ee ‘) . : . eo ‘) . & ) 


k=0 k=0 
and n 2 2 
m\"(n+2m—k m+n 
rimmnd= 3 (F) am) n”) 
k=0 
Notes 
[1] Both of the examples in this section are from Egorychev (2), pages 52 and 
169. 


[2] In the paper by Gillis et al. [3] the following representation of the Legendre 
polynomials is used to evaluate the integral i Pn, (£)+++ Pn, (x) dz, where 


M1,...,Ne are non-negative integers: 
Pa(2) = 27" > (-1) @) @ = ‘ nook 
k<n/2 * 


[3] Bressoud [1] uses a combinatorial approach to evaluate integrals of the form 


w/2 w/2 + 2k(a) : . 
aft Se) [Tees sin oda,...dai, where S is a set of nonlinear 


sums of elements of the {a;}, and & is an integer-valued function. 
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9, Summations: Other 


Idea 
Some summations can be determined by simple manipulations of in- 
tegrals. 
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Procedure 

One technique for evaluating infinite sums is by use of the Watson 
transform (see page 44). Under suitable convergence and analyticity con- 
straints, we have: 


Theorem: If g(z) is analytic in a domain D with a Jordan 
contour C, then 


a = fo) cot rz dz = >= on) 


for those integers n that are within C. 
Alternately (see Iyanaga and Kawada [1], page 1164): If an analytic func- 
tion f(z) is holomorphic except at poles a, (n = 1,2,...,4) in a domain 
bounded by the simple closed curve C and containing the points z = m (for 
m=1,2,...,N), then 


> f(m) = sa ft (cot rz) f(z) dz — 5 Res [x(cot rz) f(z)] 


m=1 n=1 Z=An 


When the left-hand side is replaced by yr (-1)™ f(m), then the cot zz 
must be replaced by cosec 72. 

Another technique that can be used to evaluate summations is the 
Euler—Maclaurin summation formula. From Wong [3] (page 36) we find 


If f(t) is defined on 0 < t < 00, and if f")(t) is absolutely 
integrable on (0,00) then, for n = 1,2,.. 


(OMI i f(x) de + 3 [F(0) + F(n)] 
0 


m=-1 
+ d ai [f°°°-» (n) = f°? (0)] ae Ra(n), 
; (9.1) 


n 
where the remainder is Rm(n) = i Bom — ae - {)) fP™ (x) da. 


0 
The remainder can be bounded by 


JRoon)| < (@— ata) Hat P| g2™ (0) ae. 


In this theorem, the Bernoulli polynomials {B,(z)} are defined by the 
generating function 


= ys B (2) (9.2) 


s=0 


The Bernoulli numbers {B,} are given by B, = B,(0) and a generating 
function for them can be obtained from (9.2), by setting x = 0. 


et -—1 
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—-N-1 


Figure 9.1 Contour for the integral in (9.3). 


Example 1 
As an example of the Watson transform, consider the sum 
S =", 1/(n? +a”). We define the integral 


Test [ BO) as (9.3) 
2mt Jey 2 +a 
where Cy is the contour shown in Figure 9.1. Note that the vertical and 
horizontal sides to Cy are at the values —N — 4 and N + ‘. 
The contour integral in (9.3) can be evaluated by using Cauchy’s 
theorem (see page 129). The poles within the contour are at z = xia, 
0, +1, +2,..., +N. The residues at tia are 7 cot(+iza)/(+2ia), and the 


residue at z = n (for n = 0, +1, ..., +N) is 1/(n? +a”). Hence, 
N ; ' 
1 mcot(iza)  acot(—ima) 
i= ————_ + ————_ |. 9.4 
2 n? + a? 7 2ia * —2ia we) 


As N — om, it is easy to show from (9.3) that J — 0. Indeed, since 
the cotangent function is bounded, we have J = O(N~?) O(N) — 0 as 
N — oo. Taking the limit as N — oo, and combining (9.3) and (9.4), we 
find 


[ee] ° ° 
1 mt cot(t7a nm cot(—z7a 

> = rn | pe eg 

n° +a 2ia —2ia 

nm=——Co 
or - 
1 T 1 
> me a. a = 2a coth Te — jae (9.5) 
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If the limit a — 0 is taken in this formula, then we obtain the well-known 
result (see also Example 3): )\°0.,n~? = 17/6. 


Example 2 


As an example of the Euler—-Maclaurin summation formula, consider 
the harmonic numbers, defined by Hy = t+ +5 +...+ +. Using (9.1) we 
find: 


m—-1 
H,, = logn-+ 5 (1 + p> > Gall - eit _ (23 — 1} +Rmp(n-1), 
(9.6) 
where 
n—-1 _ = 
Rain 1)= f° Ema Pinle LD gy 


Taking the limit of n — oo in (9.6) results in an expression for Buler’s 
constant 7: 


oo — — 
where the error term is given by Em = / Bim — Ban (2 — [21) dr 
0 (1 + x) 


Example 3 


As an example of a different technique, consider the evaluation of the 
zeta function at an argument of two: ¢(2) := (°°. n7?. We have 


cae | 


ie Lome 2 GnF 


ea 
- oor at 4$() 


rs 


i 
-3 oa 
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Since i x?" dz = 1/(2n + 1), we can write ( Sov" dy) ( So ao" dz) = 
1/(2n +1)”. Therefore, we have 
“1 


i pe 4 (2n +1)? 


is f [en ae ay 


n=0 


=i[ [ S (cy) de dy 


n=0 


-4/" ee — 


Now make the change of variables from {z, i to {u,v} via c = sinu/cos_v, 
y = sinv/cosu. The Jacobian of the transformation is given by 


pe O(z ’ y) —|7u Yu 
O(u, v) Ly YW 
cos u sin usin v 
_| cosy cos? v 
sin v sin u COS U 
cos? u COs u 
=1 sin? usin? v 


cos” ucos? v 
=1-27y’. 


Continuing the calculation of the zeta function, we find 


4f' f! dxdy 
¢(2 =5/ peat aS 
@) o Jo — 


“ih hi i-s 7m ——z-3 du du (9.7) 


The region of integration in the (u,v) plane becomes the triangle with 
vertices at (u = 0,v = 0), (u = 0,v = 7/2), and (u = 7/2,u = 0) (see 
Figure 9.2). Since this triangle has area 77/8 we finally determine 

a. 38 


= 35 =e 
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Figure 9.2 Integration region in (9.7). 


Notes 
[1] Under some continuity and convergence assumptions, the Poisson summa- 
tion formula states (see lyanaga and Kawada [1], page 924) 


foe] 


Ye sey= fer peat. 


n=—c n=—0o 


(This formula can also be extended to functions of several variables.) 
2 
For example, if we take f(t) = e~”* 7 (for some fixed z > 0), then we 


obtain 
co fo ¢] ove) 
> en tnt _ » / e2tint—mt?z 
n=—00 n=-00 % ~& 
(9.8) 
ag ee (-=) 
face * 


For small values of z, the sum on the right-hand side of (9.8) converges much 
more quickly than the sum on the left-hand side. See also Smith [2]. We 
note in passing that the equation in (9.8) represents the following functional 


relationship of theta functions: @(z) = 78 (=) ; 
"7 


{2] For another example similar to Example 1, the summation 


, i _p¢ mcos2(7 —t) 
can be derived from the integral fracl2zi [., penn 
References 

(1] S. Iyanaga and Y. Kawada, Encyclopedic Dictionary of Mathematics, MIT 
Press, Cambridge, MA, 1980. 

[2] P. J. Smith, “A New Technique for Calculating Fourier Integrals Based on 
the Poisson Summation Formula,” J. Statist. Comput. Simulation, 33, No. 3, 
1989, pages 135-147. 

[3] R. Wong, Asymptotic Approzimation of Integrals, Academic Press, New 
York, 1989. 


40 I Applications of Integration 


10. Zeros of Functions 


Applicable to Functions with zeros that we would like to characterize. 


Idea 
By evaluating certain integrals, information about the location of zeros 
of functions can be obtained. 


Procedure 

There are several theorems that can be used to determine the location 
of zeros of functions. We illustrate two such theorems. 

A standard theorem from complex analysis states (see Levinson and 
Redheffer [6], Theorem 6.1): 


Theorem: Let f(z) be a meromorphic function in a simply 
connected domain D containing a Jordan contour C. Suppose 
f has no zeros or poles on C. Let N be the number of zeros 
and P the number of poles of f in C, where a multiple zero 
or pole is counted according to its multiplicity. Then 


1 [fe 
ma [GG eN-P. (10.1) 


The principle of the argument is the name given to the statement: 


NP = arg f(z) 


= (10.2) 


c 
which is just a reformulation of (10.1). (Note that “arg” denotes the 
argument or phase of the following function.) The quantity N — P is also 
known as the index of f relative to the contour C. See Example 1 for an 
application of (10.2). 


Another useful theorem is (see Bharucha-Reid and Sambandham [1], 
Lemma 4.9): 


Theorem: If f(t) € C' for a < t < b and f(t) has a finite 
number of points in a < t < 6b with f’(t) = 0, then the 
number of zeros of f(t) in the interval a < t < b is given by 


oo b 
nabif)= go fade f coslcsls'(lat 


where multiple zeros have been counted once. 


See Example 2 for an application of this theorem. 
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iR C 


Figure 10. The contour used in Example 1. 


Example 1 

Consider the polynomial z3 — z? + 2. How many roots does it have 
in the first quadrant? We will use the principle of the argument with 
f(z) = z3 — z? +2 and the contour in Figure 10.1 as R — 00. 

To use (10.2), we must determine how the argument of f(z) changes 
on the three components of the contour C: 


e The horizontal component (y = 0 and 0 < x < R): We observe that 
f(0) > 0 and f(co) > 0. Since there is only one inflection point of 
f(z) on this component (at z = 2), we conclude that f(z) is always 
positive on this segment. Hence, there is no change in arg f on this 


segment: 
z=R 


=0, (10.3) 
z=0 
e The curved component z = Re‘? with 0 < @ < 2: On this component, 
f(z) = R3e3(1 + w) where |w| < 2/R for large values of R. Hence, 
arg f (Re) = 30 + arg(1 + w). Therefore, 
6=n/2 


arg f(z) 


arg f (Re'®) - 3m + €}, (10.4) 

é=0 2 
where €; —~ 0 as R — oo. 

e The vertical component (z = 0 and 0 < y < R): We observe that 
f(iy) = (-y? + 2) + i(—-y?). As y decreases from R to 0, Re f(iy) 
changes its sign at y = V2 from negative to positive, while Im f(iy) 
remains negative. Hence, as y decreases from R to 0, f(iy) starts in 
the third quadrant and ends in the fourth quadrant. Therefore, 


y=0 


3 
= in S+eg= 5 +60, (10.5) 


arg f (iy) 
y=R 
where €2 ~ 0 as R — oo. 


Combining the results in (10.3), (10.4), and (10.5) we find that 
37 w 
arg f(z)le =0O+ (= +e] + (5 +2) . 


As R — oo we conclude that arg f(z)| ¢ = 2m. From (10.2) we conclude, 
therefore, that there is exactly one root of f(z) in the first quadrant. 
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Example 2 

In this example we answer the question: “What is the average number 
of real roots of the polynomial f(z; a) := a9 + a12 +...+@n—12"~! when 
the {a;} are chosen randomly?” The analysis here is from Kac [5]; see also 
Bharucha-Reid and Sambandham [1]. 

For definiteness, we presume that the {a;} lie on the surface of the 
n-dimensional sphere of radius unity, 5,(1) (i.e., the {a;} satisfy |a|? = 

a a? = 1). Define N,(a) to be the number of real roots of f(z; a). 

A simple scaling argument shows that N,(aa) = N,(a) for any non-zero 
constant a; this will be needed later. 

Define M,, to be the average number of real roots of the polynomial 
f(a;a) as a varies over S,,(1). That is, 


il 
M—,.:= =o 
eS) Js.) 


(Here do represents the surface element on a sphere.) It is not difficult to 
show that M, can also be represented in the form 


1 to} oo 1 2 
M, = Gn? rf of e~ 2/8!" nN, (a) da 
7 —00 —00 


(where da = dag da, ... dan_ 1), since this last integral can be rewritten as 
follows: 


N,,(a) do. 


M. : ea N,(a) do, | d 
eo _—_———— r T 
“ (2m)? Jo Sa(r) 
fo 0) 
=a | et /2 | anol N,(a) do } dr 
(27)""" Jo Sn (1) 


1 
=a ( aes N,(a) to) 


If we we use the notation ()") to denote the number (or fraction) of 
real roots in the interval (—1, 1) and ()'?) to denote the number (or fraction) 
of real roots not in the interval (—1,1), then Ni (a) = Ne) (a) because 


-1 a = = Z : 
hoo Okt® = ( pop nAZke t) z"—1_ (That is, for every polynomial 


having z as a root, there is a corresponding polynomial with x7! 
root.) This implies that Ma) = M.”) (a) and M,,(a) = 2MS)(a). 

Using the second theorem stated in the procedure, with a = —1 and 
b = 1, we find that 


get [Pf -arrgt [Pa f 
MOP =a | [eer da fac [cos swiis' eae 
(10.6) 


as a 
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(Note that we write f(t) for the function f(t;a).) Interchanging the order 
of integration, and recognizing that the absolute value function has the 


oe 
simple integral representation |y| = — so ay. allows (10.6) to 
mT J_ n’ 


Mad [ at [ d¢ R(¢, t) 
n on Ms fae 2°}9 


R(6,t) = : [ 7 [s(t,¢,0) - S(t, ¢, no 


be written as 
where 


and 
Stim) = aoe f_- [ eW8P ancoslcr()]c00inf) 


Writing the cosine function in complex exponential form allows the a- 
integrals to be evaluated (recall that f(t) = f(é;a)) to determine that 


S(t,¢,n) = 5° (- ; 
k=0 


+e (- LS (ct - mnt") | 


k=0 


n-1 


(ct* + int") 


Hence, 
oo n—- n=- nmi 
R(G,t) = = / [e629 Lenco 92) Lika (cet tent)" SD, 
T J—oo q 
If we define the functions A,(t) = p25 t*, Bn(t) = Spzg kt?*-}, and 
Cn(t) = pro &?4?*, then we can finally find 


mo a2 [ VAC = BE 
fh == age 2 


Our final answer is therefore 
7 (na = 2) 
1 1 1 — ¢2" 
a G).. = ae 10.7 
M,, = 2M{ =i, =e (10.7) 


2 
An asymptotic analysis then reveals that M, ~ = logn as n — oo. 
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Notes 

[1] The same result in (10.7) is obtained in three different cases: 

(A) The {a;} are chosen to be uniformly distributed on the interval (—1, 1); 

(B) The {a;} are chosen to be equal to +1 and —1 with equal probability; 

(C) The {a;} are chosen to be uniformly distributed on the unit ball (as 
shown in Example 2). 

(2) IfC* is the image of C under f in the first theorem in the Procedure, then 
N — P turns out to be equal to the number of times C* winds around the 
origin; i.e., it is the winding number of C* with respect to the origin. 

[3] In example 1, the polynomial f(z) = z* — z? +2 has the roots z = —1 and 
z=1+1. 

[4] If g(z) is analytic in D, the zeros of f(z) are simple and occur at the points 
{a;}, the poles of f(z) are simple and occur at the points {b;}, then the 
result in (10.1) may be extended to 


a : a g(z) dz =} ° 9(ai) — >) 9(bi). (10.8) 


If we choose f(z) = sin zz, then (10.8) becomes 


_ [a cot mzdz = >»: g(n), 


for those integers n that are within the contour C. This formula is very 
useful for evaluating infinite sums; it is known as the Watson transform. An 
example of its usage may be found in the section beginning on page 34. 

(5) Rouché’s theorem compares the number of zeros of two related functions. It 
states (see Levinson and Redheffer [6], Theorem 6.2): 


Let f(z) and g(z) be analytic in a simple connected domain 
D containing a Jordan contour C’. Let |f(z)| > |g(z)| on C. 
Then f(z) and f(z) + g(z) have the same number of zeros 
inside C. 


This theorem can be used to prove that a polynomial of degree n has n roots. 
For the polynomial h(z) = }<"_, aiz* of degree n, choose f(z) = agz” and 


g(2z) = h(z) — f(z). i 
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Idea 
This section describes other uses of integration. 


Physics 
Let F be the force on an object in three-dimensional space. The work 
done in moving an object from point a to point b is defined by the line 


integral 
b 
W= [ F - ds, 
a 


where s is an element of the path traversed from a to b. In a conservative 
force field, the force can be written as the gradient of a scalar potential 
field: F = VP. In this case, the amount of work performed is independent 
of the path and is given by W = P(b) — P(a). 

For example, since gravity is a conservative force field, g = (0,0,g) = 
V(gz), the work performed in moving an object from the location a = 
(az, ay,a@,) to the location b = (bz, by,6z) is just W = g(bz — az). 


Mechanics 

The momentum of a rigid body K is defined by Q = f(dr/dt)dm 
where dm is the mass of the volume element at a point r and (dr/dt) is its 
velocity. See Iyanaga and Kawada [6], page 454. 

The angular momentum of a rigid body, about an arbitrary point ro, 
is defined by H = f(r — ro) x (dr/dt)dm. See Iyanaga and Kawada (6), 
page 455. 


Mechanics 


If V2u = —1 in G, and u = 0 along OG, then the torsional rigidity of 
the domain G is defined to be P=4 ff udA. For a disk of radius R, we 
G 


have P = 7R*/2. See Hersch [4]. 
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Notes 

(1] Using an integral representation of derivatives, Calio et al. [2) demonstrate 
how quadrature formulas can be used to differentiate analytic functions. 

[2] Let Q be a bounded two-dimensional domain with a partly smooth curve of 
boundary. Aizenberg [1] contains an integral representation for the difference 
between the number of lattice points of Q and its volume. Then a similar 
result for a three-dimensional domain is given. 

[3] Ioakimidis [5] uses contour integrals to find the location of branch points. 
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II 


Concepts and 
Definitions 


12. Definitions 


Asymptotic Expansion Let f(x) be continuous in a region R and let 
{¢n(z)} be an asymptotic sequence as x — Zo. Then the formal series 
>, 0 2n¢n(x) is said to be an infinite asymptotic expansion of f(x), as 
x — Xo, with respect to {¢,(x)} if the equivalent sets of conditions 


f(z) = » Angn(z) + O(dm4i(Z)), as 2 — Zo, (12.1) 


n=0 
f(t) — > angn(2) 
. n=0 a : 
ea om (x) ” (12 2) 


for each m = 0,1,2,... are satisfied. If, instead, (12.1) only holds for 
m=0,1,2,...,N—1, then 


N-1 
f(t)~ >> andn(z), as z— xo 


n=0 
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is said to be an asymptotic expansion of f to N terms with respect to the 
asymptotic sequence {¢,(x)}. Note that O() is defined on page 351. 


Asymptotic Sequence The sequence of functions {¢,(z)}, n = 0,1,2,... 
is called an asymptotic sequence as + — 29 in some region R if, for every n, 
¢n(z) is defined and continuous in R and ¢,41(r) = o(¢n(z)), as Z > Zo. 


Auxiliary Asymptotic Sequence Let {¢,(z)} be an asymptotic se- 
quence as  — Zo. Then the formal series )\~.)@nfn(x) is said to be 
an asymptotic expansion of f(z), with respect to the auziliary asymptotic 
sequence {¢n(z)} if 


N 
f(t) = )7 fa(2) + (gn (2), a8 x > zo, 
n=0 
for each m = 0,1,2,.... This is denoted f(r) ~ )\°2, fn(x) when the 
auxiliary asymptotic sequence is understood. 


Borel Field of Sets Given a system of sets M, the Borel field of sets 
is the smallest system of sets containing M and closed with respect to the 
operations of countable union and taking complements. 


Bromwich Integral The Bromwich integral is a contour integral that 
has the shape of a semicircular region, extending to infinity, with the flat 
portion vertical in the complex domain. 


Holomorphic Function A function is holomorphic in a domain if it is 
holomorphic at every point in the domain. A function is holomorphic at a 
point if it satisfies the Cauchy—Riemann equations at that point. 


Inner Product An inner product is a binary operation on a vector space 
which produces a scalar. The inner product must also satisfy the following 
properties (where a, b, and c are vectors, z is a scalar, and an overbar 
indicates complex conjugation): 

[1] (a,b) = (,a) 

[2] (a,b+c) = (a,b) + (a,c) 

[3] (za,b) = z(a, b) 

[4] (a,a) > 0, unless a = 0, when (0,0) = 0 


Integrand In the integral { : f(x) dz, the integrand is f(z). 


Jacobian The Jacobian, or the Jacobian determinant, is denoted by 
O(F,G,H,...)/O(u, v,w,...) and is defined to be the determinant 


RF Fw 
O(F,G,H,...)_|G@u Gy Gu 


O(u,v,w,...) |Hu Hy Hy 


When used in a change of variable computation (see page 109), the absolute 
value of the Jacobian is used. 


12. Definitions a6 
Dy Functions A measurable function f(x) is said to belong to Lp if 
Io” \f(2)I? dz is finite. 


Lebesgue Measurable Set_ A set of R? is called a Lebesgue measurable 
set (or simply a measurable set) if it belongs to the smallest o-algebra 
containing the Borel sets and the sets of measure zero of R?. 


Leibniz’s Rule __Leibniz’s rule states that 


d g(t) ; ; xt) Oh 

S( [needs] =a@nto) - rons + fo Feeae. 
dt \ J s(e) ge) Ot 
Linear Independence Given the smooth functions {y1, yo,..-, Yn}, the 


Wronskian is the determinant 


Yi Yy2 see Yn 
Vj Yo oo Un 
yr) yr) ae yr) 


If the Wronskian does not vanish in an interval, then the functions are 
linearly independent. 


Lower Limit, Upper Limit In the integral f” f(x) dx, the lower limit 
is the value a, the upper limit is the value b. 


Measure _ A (positive) measure on a o-algebra A is a mapping pu of A 
into [0, co] such that if E is a disjoint union of a sequence of sets E,, € A, 
then n(EZ) = )) u(E,). 


Meromorphic Function A meromorphic function is analytic, except 
possibly for the presence of poles. 


Norms If f is a measurable function on R® then we define the Lp norm 
1 
of f (for 0 <p < 00) by [Ifllp = (Sian f(x)? dx) ””. 


Orthogonal Two functions f(z) and g(x) are said to be orthogonal 
with respect to a weighting function w(z) if the inner product vanishes, 
ie., (f(x), 9(x)) := J f(x)w(x)9(x) dx = 0 over some appropriate range of 
integration. Here, an overbar indicates the complex conjugate. 


Pole An isolated singularity of f(z) at a is said to be a pole if f(z) = 
9(z)/(z—-a)™, where m > 1 is an integer, g(z) is analytic in a neighborhood 
if a and g(a) # 0. The integer m is called the order of the pole. 


Sigma-algebra A family A of subsets of a set X is called a o-algebra 
if the empty set is in A, and if A is closed under complementation and 
countable union. 
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Set of Measure Zero A set E in R? is called a set of measure zero (or 
a negligible set) if there exists a Borel set A such that E C A and v(A) = 0. 


Variations Let f(z) be a real bounded function defined on [a, b]. Given 
the subdivision a = rp < 21 < ... < Zn = 5, denote the sum of positive 
(negative) differences f(x;) — f(zj-1) by P (—N). The suprema of P, N, 
and P + N, for all possible subdivisions of [a,b], are called the positive 
variation, the negative variation, and the total variation of f(x) on [a, d]. 
If any one of these three values is finite, then they are all finite. In this 
case, f(x) is said to be of bounded variation. 

The continuous function asin + is not of bounded variation, while the 
discontinuous function sgn z is of bounded variation. 

If g(x) is an increasing function on [a,b] then the total variation of 
g(x) on [a,b], written varj,.j9, is given by g(b) — g(a). Hence, by writing 
an arbitrary continuous function f(x) as the difference of two increasing 
functions f(x) = f(x) — fo(x) we find 


var [a,b f = varja,ejf1 + varfa,o fi = (f1(b) — f1(a)) + (fe(b) — fe(a)). 
One way to form the decomposition f(z) = f(x) — fe(x) is by 


f(z) = | “Ur (e)|* dt, fala) = | "UC at 


(Note that the notation []~ and []* is defined on page 352.) 


Bounded Variation A function g(x) is of bounded variation in [a, }] if 
and only if there exists a number M such that 5>;~, |g(z:) — 9(2i-1)| < M@ 
for all partitions a = Zp < 41 < Zo < -+: < Lm = b of the interval. 
Alternately, g(x) is of bounded variation if and only if it can be written 
in the form g(x) = gi(x) — go(x) where the functions g;(z) and go(x) are 
bounded and nondecreasing in [a, }]. 


Weyl’s Integral Formula Let G be a compact connected semisimple 
Lie group and H a Cartan subgroup of G. If u, 8, and 4 are all normalized 
to be of total measure 1, then 


1 = * 
[seoramtor = Jf gf (ghar?) 30m) arto") aacm 


for every continuous function f on G, where w is the order of the Wey] 
group of G. Here J is given by 


Il (etx? Es e~0()/2) 


aeéP 


2 
J(exp X) = 


where P is the set of all positive roots a of G with respect to H and X is 
an arbitrary element of the Lie algebra of H. 
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13. Integral Definitions 


Idea 
There are many different types of integrals of interest. These integrals 
include the following: 


Abelian (see below) Cauchy (see page 92) 
contour (see page 129) Feynman (see page 70) 
fractional (see page 75) Henstock (see below) 
improper (see below) Ito (see page 186) 
Lebesgue (see below) line (see page 164) 
loop (see page 4) path (see page 86) 
Riemann (see below) stochastic (see below) 
Stratonovich (see page 186) surface (see page 24) 


Properties of Integrals 


Lebesgue [16] defined six properties that the integral of a bounded 
function should have. These properties are: 


1] f. f(a) de = firth f(a — h) de; 

2] fo f(x) dx + fo f(x) dx + f° f(z) dz = 0; 

[3] J Ufi(z) + fola)] de = fF fa(z) dx + JP fala) de; 

[4] fo 1dz = 1; 

[5] If f >Oandb>a, then f’ f(x) dz > 0; 

(6) If fa(z) < fati(z) and limpoo fna(z) = f(x) for all x, then 


limy—oo fe faz) de = f? f(a) de. 


Squire [22] indicates that more than sixty kinds of integrals have been 
developed that satisfy the above criteria, in different degrees of generality. 
In the following sections we describe only a few of the different types of 
integrals. Pesin [20] has a very comprehensive review of many types of 
integrals. 


Abelian Integral 


Suppose that we have an algebraic curve whose equation is G(x, y) = 0. 
Let y = f(x) be the algebraic function satisfying this equation, and define 
S to be the associated Riemann surface on which y is single-valued. Define 
the rational function R by R(x, y) = P(z, y)/Q(z, y), where both P and Q 
are polynomial functions. Note that R is single-valued on S and that the 
only singularities that R has on S are a finite number of poles. 

An Abelian integral has the form I(z, y) = Sc. . R(x, y) dz, where the 
path of integration is on the surface S. The value of this integral depends 
upon the integration path. Note that I(z,y) is regular for all finite paths 
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that avoid the poles of the integrand. There are only three kinds of Abelian 
integrals; an Abelian integral is of 


[1] the first kind if it is regular everywhere, 
[2] the second kind if its only singularities are poles, 
[3] the third kind if it has logarithmic singularities. 


No other types of singularities are possible for an Abelian integral. 

Note that an Abelian integral can be of the first kind and not be 
constant; Liouville’s theorem does not apply since J is defined on a Riemann 
surface, not the complex plane. 

If the limits of integration are fixed, then all possible values of an 
Abelian integral can be determined by considering the combinatorial topol- 
ogy of S. Fixing the points A and B on S, define J = f) R(z,y) dz. If P is 
a specific path on S from A to B, then any other path from A to B is of the 
form P +I, where I is a closed path passing through A and B. Define K 
to be the Abelian integral associated with the path T: K = te R(z, y) dx. 
Note that the value of K is not changed as I is continuously distorted, 
provided that I stays on S and does not cross any poles of R(z, y). 

As an example, elliptic integrals can be defined by: R(x, y) = 1/y and 
G(x, y) = (1 — 2?)(1 — k?x?) — y? =0. 

Much research has been performed on the inversion of Abelian inte- 
grals. For example, Theorem 6.2 of Bliss [1] (page 170) states that: 


Theorem: If an Abelian integral u = oS n(x, y) dz on 


the Riemann surface T of an irreducible algebraic equation 
f(z, y) = 0 defines a single-valued inverse function x(u), y(u), 
then the genus of the curve f = 0 must be either p = 0 or 
p = 1. In the case p = 0 the integral is either of the second 
kind with a single simple pole, or of the third kind with two 
simple logarithmic places and no other singularities. In the 
case p = 1 the integral is of the first kind. 


For details, see Hazewinkel [8] (pages 14-16), or Lang [15]. 


Henstock Integral 


Given the interval (a, b] and a positive function 6 : [a,b] > R, define a 
partition to be given by {(t;, [zi-1,2:])};_,, where the intervals [x;~-1, x4] 
are non-overlapping, their union is the interval (a, b], and the following con- 
dition is satisfied: t; € [vj-1, x;] C (tj — 6(t:), t; + 6(t;)), for 7 = 1,2,...,n. 

A function f : [a,b] — R is called Henstock-integrable if there exists 
a number J such that for every « > 0 there exists a positive function 
6: [a,b] + R such that every partition of the interval [a,b] results in 


> f(ti) (aj — 2-1) —I| <e. 
t=1 
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The number /, usually written as [ . f(t) dt, is called the Henstock integral 
of f. For details, see Peng-Yee [19]. 


Improper Integrals 

An integral in which the integrand is not bounded, or the interval of 
integration is unbounded, is said to be an improper integral. For example, 
the following are improper integrals: 


1 dr ie dz 
— and ae 
o ft 9 1+2 


Suppose that f(z) has the singular point z in the interval (a,b), and 
suppose that f(x) is integrable everywhere in the interval, except at the 


point z. The integral f f(x) dz is then defined to have the value 


z-a b 
a tf f(z) dz + [,, i(e)aeh ; 


where the limits are to be evaluated independently. 


Lebesgue Integral 

Let X be a space with a non-negative complete countably-additive 
measure pt, where pp(X) < co. Separate X into {X,,} so that UPL, X, = X. 
A simple function g is a measurable function that takes at most a countable 
set of values; that is g(x) = yn, with yn # yz, forn # k, ifs € X,. A simple 
function g is said to be summable if the series )-y~, ynu'Xn Converges 
absolutely; the sum of this series is the Lebesgue integral [ x9 dp. 

A function f : X — R is summable on X (denoted f € £,(X, p)) if 
there is a sequence of simple, summable functions {g,}, uniformly conver- 
gent to f on a set of full measure, and if the limit limpoo [ x 9n dp is finite. 
The number J is the Lebesgue integral of the function f; this is written 


r= ff fay. (13.1) 


A simple figure can clarify how the Lebesgue integral is evaluated. 
Given the function f(z) on (a,b), subdivide the vertical axis into n + 1 
points: min f > yo < y) <--- < yn > max f. Then form the sum 


So vi-1 x measure (x | y;-1 < f(z) < y;) 

i=l 
in which the measure is the sum of the lengths of the subintervals on 
which the stated inequality takes place. (See Figure 13.1.) In the limit of 
n — oo, as the largest length (y; — y;-1) tends to zero, this sum becomes 
the Lebesgue integral of f(z) from a to b. 

The Lebesgue integral is a linear non-negative functional with the 

following properties: 
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f(z) 
¥5 


Y4 
¥3 
Y2 
Yi 


Yo 


a b z 
Figure 13.1 A schematic of how the Lebesgue integral is to be evaluated. 
Regions with similar values are shaded in the same way. 


[1] If f € £i(X, pw) and if w{z € X | f(r) # h(x)} =0, then h € Ly(X, p) 
and Sy fap = Sx hdp. 

[2] If f € L1(X, w), then |f| € Li(X,p) and | fy f dul < fy lf du. 

[3] If f € Li(X,p), |h| < f and h is measurable, then h € L,(X, p) and 
[Sx hdp| S fx f dp. 

[4] Ifm< f <M and if f is measurable, then f € L,(X,) and mpX < 
Sy fdp< M px. 


For functions from R” to R, if the measure used is the Lebesgue 
measure, then (13.1) may be written as J = f,,, f(z) dx. For different 
measures, the functional J is called a Lebesgue-Stieltjes integral. 

Every function that is Riemann integrable on a bounded interval is 
also Lebesgue integrable, but the converse is not true. For example, the 
Dirichlet function (equal to 0 for irrational arguments, but equal to 1 for 
rational arguments) is Lebesgue integrable but not Riemann integrable. 

Alternatively, the existence of an improper Riemann integral does not 
imply the existence of a Lebesgue integral. For example, the integral 
J’ sinz/zdx = 1/2 is not Lebesgue integrable because Lebesgue inte- 
grability requires that both f and |f| should be integrable. In this example 
Jo |sina|/x dz = oo. 


Riemann Integral 

Let f(z) be a bounded real-value function defined on the interval J = 
{a,b]. Denote a partition of I by D = {zo,...,2%n} where a = ro < 4 < 
... < Zn = band nis finite. Let I; denote the sub-interval [z;,2;41]. Define 


m; = inf f(z), Mj; = sup f(z). 
zl; zél; 
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f(z) 


x zr 


Figure 13.2 An illustration of the lower (left) and upper (right) sums of a 
function. 


The oscillation of f on J; is defined to be M; —m;. Now define the Darboux 
sums @(D) and g(D): 


a(D) = SM; (ti-2:-1),  a(D) = Som (a; — Z;-1). 
i=1 i=l 


Considering all possible partitions of D, we define 


Fe 
Riemann upper integral of f = / f(x) dz = inf a(D), 


b 
Riemann lower integral of f = | f(x) dz = supa(D). 
Ja D 


(See Figure 13.2.) If the Riemann upper and lower integrals of f coincide, 
then the common value is called the Riemann integral of f on [a,b] and is 
denoted by f : f(z) dz. In this case, the function f is said to be Riemann 
integrable, or just integrable. 

Darboux’s theorem states that: 


Theorem (Darbouz): For each € > 0 there exists a positive 6 
such that the inequalities 


pb b 
3(D) - / i@ealee -lewys / f(x) de] <e, 


hold for any partition D with max(z; — zi41) < 6, fori = 
| Pee 


From Darboux’s theorem we conclude that necessary and sufficient 
conditions for a function f(z) to be integrable on [a,b] is that for each 
positive ¢ there exists a 6 such that 


n b 
S- F(G)(ej - 25-1) - i f(x) de] <e, 
j=l 2 


where 6(D) = max;(x; — z;-,) < 6 and ¢; is chosen arbitrarily from J;. 
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Stochastic Integrals 


Let X(t) be an arbitrary random process defined in some interval 
a <t < b and let A(t,r) be an arbitrary deterministic function defined 


in the same interval. Define the integral I(r) = ie h(t,7r)X(t) dt. If the 
integral exists, then I(r) is, itself, a random variable. 
The integral can be shown to exist for each sample function z(t) if 


b b 
i, Elln(t,r)X(t)|] at = / \h(t, 7) |E[X(t)] dt < 00. 


Furthermore, when the integral exists, we can write 


E[I(r)] =E | / ” hltr)X(0) a - i ” a tr) BLX(t)) ae, 


and the interchange of the order of integration and the expectation opera- 
tion is justified. 

Even if the integral does not exist in the usual sense for each sample 
function x(t) of X(t), it may be possible to define the equality in some 
stochastic sense. (See page 186.) 


Notes 
[1] Other properties of an integral can be inferred from the stated properties 
of integrals. Let I denote the set of all functions integrable on the interval 
I = [a, 6). If f and g belong to I, and a and £# are arbitrary real numbers 
then 
(A) [f| € 1, 
(B) af + Bg €I, 
(C) f*gel, 
(D) min{ f,9} € I, 
(E) max{f,g} € I, 
(F) f/g € I (assuming that |g| > A> 0 on J). 
[2] We also have the conventions f f(z) dz = 0 and i f(x) dz = - ‘hs f(x) dz. 
[3] Botsko [3] describes a generalization of the Riemann integral that admits 
every derivative into the set of integrable functions. As an example, Botsko 
considers the function f’ where 


f(2) = ary if0<2<1, 
1 if z = 0. 


The function f’ has an unbounded derivative and is not Lebesgue integrable, 
but can be integrated with Botsko’s integral. 

[4] The Burkill integral [8] was originally introduced to determine surface areas, 
see Burkill [4]. In modern usage, it is used for integration of non-additive 
functions. The Burkill integral is less general than the subsequently intro- 
duced Kolmogorov integral; any function that is Burkill-integrable is also 
Kolmogorov-integrable. The name of “Burkill integral” is also given to a 
number of generalizations of the Perron integral [20]. 


13. 


[5] 


[6] 


[7] 


[8] 


[9] 


[10] 


(11) 
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The Henstock integral is also known as the generalized Riemann integral. 
The Henstock integral and the Denjoy integral are equivalent. The restricted 
Denjoy integral includes the Newton integral and the Lebesgue integral. 
The Perron integral, the Luzin integral, the gauge integral, the Kurzweil- 
Henstock integral, and the special Denjoy integral are all equivalent. See 
Henstock [9]. In one dimension, the Perron integral is equivalent to the 
restricted Denjoy integral. A multi-dimensional Perron integral is described 
in Jurkat and Knizia [13]. 

The Boks integral [8] is a generalization of the Lebesgue integral, first 

proposed by Denjoy, but studied in detail by Boks (2]. The definition starts 

by taking a real-valued function f defined on a segment (a, 5] and periodically 
extending it to the entire real line (with period b— a). The A-integral [8] is 
more convenient to use than the Boks integral. 

Other types of integrals not described in this book include: 

(A) Banach integrals, Birkhoff integrals, Bochner integrals, Denjoy inte- 
grals, Dunford integrals, Gel’fand—Pettic integrals, and harmonic inte- 
grals (see Iyanaga and Kawada [12], pages 12-15, 337-340, 627-629, 
787). 

(B) Norm integrals, refinement integrals, gauge integrals, Perron integrals, 
absolute integrals, general Denjoy integrals, and strong variational in- 
tegrals (see Henstock {9]). 

(C) Borel’s integral, Daniell’s integral, Denjoy integral, improper Dirichlet 
integrals, Harnack integrals, Hdélder’s integrals, Khinchin’s integrals, 
Radon’s integrals, Young’s integrals, and De la Vallée—Possin’s integrals 
(see Pesin [20]). 

(D) Curvilinear integrals are better known as line integrals, see page 164. 

(E) Fuzzy integrals (see Ichihashi et al. [11)). 

(F) Kolmogorov integrals (see Hazewinkel [8], page 296). 

It is also possible to define an integral over an algebraic structure. For 

example, integrals in a Grassman algebra are discussed in de Souza and 

Thomas [21]. 

The Lommel integrals are specific analytical formulas for the integration of 

products of Bessel functions. See Iyanaga and Kawada [12], page 155. 

The notion of stochastic integration was first introduced by Wiener in con- 

nection with his studies of the Brownian motion process. Given a one- 

dimensional path X(t) and any function f(t), Wiener wanted to be able to 
define the integral iM f(t) dX(t). This integral makes no sense as a Stieltjes 
sum since X(t) is not a function of bounded variation. 
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14. Caveats 


Idea 
There are many ways in which an integration “result” may be incor- 
rect. 
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Example 1 
Consider the integral 


1 
I(a,b) = : oe (14.1) 


for real x and arbitrary nonzero complex a and b. The indefinite integral 
has the primitive log(az+6)/a. Hence, a careless “direct” derivation would 
yield the result 


? log(a+6) logb (14.2) 
rere aaa ; 


I(a,b) = - 

The problem, of course, is that the logarithm function has a branch 
cut. Hence, the two logarithms in (14.2) may not be on the same Riemann 
sheet. 

The correct way to evaluate (14.1) is to separate the region of integra- 
tion into two sub-intervals, with the division point being the value where 
ax +b may vanish. An easier way, for this integral, is to first write the 


integral as 
1 f' dz 1 b 
1(a,0) == f = ie (2 +2) 


No matter what the sign is of Im(b/a), the argument of the logarithm never 
crosses the cut (since z is real). Thus, the answer is 


I(a,b) = ; tog (1 + -) - og | . 


Note that since 1 + b/a and b/a have the same imaginary part, we may 
combine them to obtain our final answer 


1 


0 


I(a,b) = * log 2. 


Example 2 
Consider the simple integral 


[? as log x. (14.3) 


Clearly, the integrand (1/z) is an odd function, yet log x is neither an even 
nor an odd function. Hence, there must be an error in (14.3). The error in 
this case is simple, the integral should be written as 


dz 
/ = log |z|. 
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Now the fact that the result is an even function is clearly indicated. 
As a similar example, consider the integral 


I= l= 2 sin-! =. (14.4) 
Vv a2 = 2 a 

when || < a. The integrand is an even function of both z and a, so that 
the formula for the integral should be odd in z and even in a. However, 
the formula in (14.4) is odd with respect to both x and a. The correct 
evaluation of the integral in (14.4) can be written as J = sin~}(z/|a|) or as 
I = tan-! ————. 
Example 3 

Consider the integral J = je * dz/(2+sinz). Since this integrand has 
an elementary indefinite integral we readily find 


£ 4n 
i dr pees ahold 
9 2t+sinzr V3 V3 ; (14.5) 
2 _; 2tan27 +1 _; 2tan0+1 
= — |tan™* ——=—__ — tan ——=—_ 


v3 v3 V3 


Now we must carefully consider what branch of the inverse tangent function 
to take in each of these two terms. In this case, we must take 


2tan27 +1 1 T 
tan”) ————_——- = tan"! —~ = 274+ — 
v3 v3 6 
1 
tan~! Acasa ae = tan"! a =< 
v3 3 «6 
so that I = Z (ar +2 =) — (= )) =- 
v3 a 
Notes 
[1] Very few tables of integrals use absolute value signs, such as are required in 
Example 2. 


(2] If the principle branch of the inverse tangent function were chosen for both 
terms in (14.5), then the calculation would return the value zero. This 
should be identified immediately as being in error, since the integrand is 
always positive. 

Observe that contour integration techniques (see page 129) can quickly 
yield the correct evaluation of J in Example 3. 

[3] Particular care must be used when a symbolic manipulation package (see 
page 117) is used to compute a definite integral. Results from such packages 
may be incorrect for many reasons; choosing the wrong branch cut, as 
Example 3 illustrates, is a common error. 
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15. Changing Order of Integration 


Applicable to Multiple integrals. 


Yields 
A different multiple integral. 


Idea 


Sometimes the order of integration in a multiple integral can be changed. 
This may make it easier to evaluate the integral. 


Procedure 


When Fubini’s theorem is satisfied, the order of integration in a mul- 
tiple integral may be changed. Fubini’s theorem states: 


Theorem: (Fubini) If f(z, y) is measurable and non-negative, 
and any one of the integrals 


A B A B B A 
[ [see fa cn [al fide 
a b a b b a 


exists, then the other integrals exist, and all are equal. 


For principal-value integrals, the Poincaré-Bertrand theorem may be 
useful (see Muskelishvili (3]): 


Theorem: (Poincaré-Bertrand) If f(z, y) is analytic, then 


f(z,y) 
I(u) = f. ~f{ fe ~ 
__ f(t,y) 

ae: uf Ens is) —# Hw) 


This theorem is also true with weaker conditions on f(z). 
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Example 
Consider the double integral 


1 1 y 
re | fahew 
0 Jo (xy? +1) 


The integrand is positive in the region of integration. In the process of 
evaluating the integral we will determine if it exists. Integrating first with 
respect to x we have 


1 1 : 
re | ay | dx—_——_ 
0 0 © (ay? + 1) 
1 as z=1 
= d —_—_———- 
I e (; (xy? + 5) 


1 
y 
= d 
f yeti 
1 y=l 
= 5 los (y? +1)[ =o 
= } log2. 


z=0 


Since this integral exists, we know that integrating first with respect to y 
will give the same answer. We demonstrate this: 


1 1 y 
1= fa f'o—, 
0 0 (xy? + 1) 
if . 1 
== | dz | dz———; 
a I “(az +1) 
1 1 


: 
f+Geam) 


z=0 
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Notes 

[1] The order of integration can make a difference if Fubini’s theorem is not 
satisfied. As an example, define the function f(x, y) = (z? — y”)/(z? + y’)?, 
and consider integrating it over the unit square. Depending on the order 
of the integrations, we will obtain different answers. Integrating first with 
respect to y results in 


y=1 


[ fen = ‘A ac [ ayy? v= [ (45) y=0 
a maint 


If, instead, we integrated first with respect to z we find 


1 1 zy? 1 ie z=1 
slew = | ay [ ade = | ay (- ) 
ie 0 o (x +y")’ 0 ety? 2=0 
1 


oy tl 4° 


[2] Other examples where the requirements for Fubini’s theorem are not satisfied 
are easy to find. For example, 


1 1 2 2 1 
r-y dx wT 
d —— 5 dy = = -, 
fel apipe- [ee 7 
[al eer [ ee 
( +7)? 0 1+2° 4° 


Another example is given by 


1 0° co 1 
/ ay | (e774 - zen) dz # / ax | (e-7¥ — 2e7?*¥) dy. 
0 0 0 0 


[3] The technique of interchanging integration order can be used to derive 
analytical formulae for integrals. 
e For example, the integral J = f f z¥ dz dy can be evaluated in two 


O¢zr<l 
asysb 


while 


different ways, 


y=b a 
St 
a 9 logz 
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1b a 
to yield the result / alia Fa log ( an °). 
9 logs l+a 


: dx dy dz 
e As a second example, the integral 5 Ocan 
: hen (1 + 272z7)(1 + y?z”) 
220 


be used to derive the relation (see George [2], page 206) 


fore) “4 2 
| (‘s*) dz = v7 log 2. 
5 z 


(4) A more general statement of Fubini’s theorem is: 


Theorem: (Fubini) Let X = R? and Y = R?; then the 
formula 


[ frosnenar= fae f toandy= fay f sens) 


is valid in each of the following two cases: 
[1] f isa measurable positive arithmetic function on X x Y; 
[2] f is an integrable function over X x Y. 
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16. Convergence of Integrals 


Applicable to Single and multiple integrals. 


Yields 
Knowledge of whether an integral converges or diverges. 


Idea 
By comparing a given integral to a different integral, the convergence 
or divergence of the original integral may be determined. 
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Procedure 

Most techniques that indicate convergence or divergence use some sort 
of integral inequality (see page 205). In this section we use the following 
two theorems: 


Theorem (Comparison test for convergence): Let f(z) and 
g(x) be continuous for a < x < b, with 0 < |f(z)| < g(x). If 


f g(x) dz converges, then f f(x) dx converges and 
0<|f- f(z) de] < f° 9(x) de. 


Theorem (Comparison test for divergence): Let f(x) and 
g(x) be continuous for a < z < b, with 0 < g(x) < f(z). If 
f g(x) dx diverges, then ie f(z) dz diverges. 


To use these theorems effectively, a knowledge base must be created 
of converging and diverging integrals. Some common integrals used for 
comparison include (assuming a < b): 


b 
(A) j aa which converges for p < 1 and diverges for p > 1. 
a (2 


b 
(B) i: od which converges for p < 1 and diverges for p > 1. 


1 
(C) =f which converges for p < 1 and diverges for p > 1. 
(D) = which converges for p > 1 and diverges for p < 1. 


oo 
(E) i “og BF which converges for p > 1 and diverges for p < 1. 


Example 1 
32 
Consider the integral J = f° 2%852dx. For the given range of 


integration (i.e., for z € [0,00o]) we can easily bound the trigonometric 
term: |zsin?x| <x. The integral J = f°. z347 dz will now be shown to 
converge, which then implies the convergence of J. First, we write 


1 or oe 
Jd =. Jo = —— dr ——_ dr. 
2 / 241 +/ Pet 


The integrand in J; is bounded above by z, and if sd: = 5 (this 
shows that J, is convergent). The integrand in J2 can be bounded above 
by x~? and f>° 2~? dx = 1 (this shows that J2 is convergent). Hence, J is 
convergent (it is bounded above by 3) and so is J. 
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Example 2 _ 
Consider the integral 


i f Gk sin(y*x*) iy) dz. 


Changing variables in the inner integral to z = yz? results in 


r=3 f° a’z* sinz 4 dz 
mers 0 vz g3/2" 


The inner integral is bounded for all a and x since f° sin? dz converges. 


The integral [7° 2—%/? dx also converges, so we conclude that J converges. 


Notes 
{1] Note that we can analytically integrate J in Example 1. We find that 


sf 5 — dz 
-~o f +1 


= Gomes a ae On Eo ) -_ 
6 (1 + z)* V3 V3 z=0 
T 
= — w 0.605. 
3V3 


[2] Another useful theorem for determining whether an integral converges is 
Chartier’s test (see Whittaker and Watson (3)) 


Theorem (Chartier): If f(z) decreases to zero monotoni- 
cally as z — oo, and | f g(t) dt| is bounded as x — oo, then 
SF f(x)$(z) dz converges. 
1 


(A) For example, consider J = [°° x’ sin dz. In this case, f(x) = x~* is 
monotonically decreasing and f> sint dt = 1 — cost, which is certainly 
bounded. We conclude that J converges. 

(B) For a more interesting example, consider J = f oa x cos(z* —2z) dz. This 
integral can be written as 


J -[ Tr (< sin(x® = z)) dz. 
1 _ 


We recognize that +/(3z? — 1) decreases monotonically, and that 


ie (< sin(z*® — z)) dz = sin(x* ~ 2), 
1 


which is bounded. We conclude that J converges. 
[3] The following decomposition 
oo : OO os oo . 
K =[ cosrsinaz 5 _ al sin(a + 1)z ran :/ sin(a — 1)z de, 
0 z 2 Jo x 2 Jo zr 
combined with the first example in the last note shows that K converges. 


[4] Divergent integrals can sometimes be regularized to obtain a finite value, 
see Wong and McClure [2]. 
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17. Exterior Calculus 


Applicable to Integration of differential forms. 


Idea 

The integral of a differential form is a higher-dimensional generaliza- 
tion of such ideas as the work of a force along a path, or the flux of a fluid 
across a surface. 


Procedure 

A real-valued function of x, also known as a scalar field, is called a 
zero-form in exterior calculus. A one-form (in, say, three space) is an 
expression of the form F, dz + Fo dy + F3dz, where F,, Fo, and F3 are 
functions of x, y, and z. 

A two-form in “standard order” is an expression of the form 


F, dy Adz + Fodz Adz + F3dz A dy. 


The inverted v’s are called carets or wedges. The wedges distinguish be- 
tween a two-form, such as 4y*dz A dz, and objects such as 4y° dz dz, 
that occur in double integrals where the order of the differentials is not 
important. 

In n-dimensional space, p-forms exist for p = 0,1,...,n. The addition 
of two p-forms, or the multiplication of a p-form by a scalar, is another 
p-form. 

The wedge product has the following properties: 


e The wedge product is associative: w A (9@AC) =(WAO)AC. 

e The wedge product is anti-commutative: w A @ = (—1)"'@ Aw, for wa 
k-form and @ an I-form. 

The wedge product of repeated differentials vanishes: dz A dx = 0 
The wedge product of a p-form and a q-form is a (p+ q)-form. 


When dealing with n-dimensional space, it is useful to deal with forms 
in a more formal way. If we choose a linear coordinate system {x1, £2,..., Zn} 
on R”, then each z; is a 1-form. If the {z;} are linearly independent, then 
every 1-form w can be written in the form w = a,2; +... + Qn2n, where 
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the {a;} are real functions. The value of w on the vector ¢ is equal to 
w(C) = a121(C)+...+@ntn(C), where 11(¢), ...,2n(¢), are the components 
of ¢ in the chosen coordinate system. 

A 2-form we is a function on pairs of vectors which is bilinear and 
skew-symmetric: 


we(A1C1 + Aaca, C3) = A1we(Ci, C3) + Agwe(Ce, C3), 
we(C1,¢2) = —we(2, C1). 


From this it is easy to derive that w2(¢,¢) = 0 for every 2-form. Analo- 
gously, an exterior form of degree k, or a k-form, is a function of k vectors 
which is k-linear and antisymmetric. 

A differentiable k-form wr, at a point x of a manifold M, is an 
exterior k-form on the tangent space TM x to M at the point x. That is, 
it is a k-linear skew-symmetric function of k vectors {¢1,...,¢,} tangent 
to M at x. Every differentiable k-form on the space R” with a given 
coordinate system {z1,...,2,} can we written uniquely in the form 


k 
w= oy Qi, ik (x) dz;, A-:-A dizi, , 
iy <i Sty 


where the {aj, ....,i,(%)} are smooth functions on R”. 

A chain of dimension n on a manifold M consists of a finite collection 
of n-dimensional oriented cells o,, ..., o, in M and integers m1, ..., Mr, 
called multiplicities (the multiplicities can be positive, negative, or zero). 
A chain is denoted by cy = myo, +...+m,o,. 

Let {z1,...,21:} be an oriented coordinate system on R*. Then every 
k-form on R* has the form w* = ¢(x) dx, A-+-Adzx, where ¢(x) is a smooth 
function. Let D be a bounded convex polyhedron in R*. We define the 
integral of the form w* on D to be 


[ota f oexars...dz, 


where the integral on the right is understood to be the usual limit of 
Riemann sums. To integrate a k-form over an n-dimensional manifold, 
the role of the usual path of integration is replaced by a k-dimensional cell 
o of M represented by a triple o = (D, f, Or) where 


(A) DC R¥ is a convex polyhedron; 
(B) f: D— M is a differentiable map; 
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(C) Or represents an orientation of D on R*. 


Then the integral of the k-form w over the k-dimensional cell ¢ is the 
integral of the corresponding form over the polyhedron D: f gu f, pi*w. 
Here the form f*w is defined by 


(f*w)(C1,- . + Ck) = w(f.i,- a feCk)s 


where the {¢;} are tangent vectors and f, is the differential of the map f. 
The integral of the form w* over the chain c;, is the sum of the integrals on 
the cells, counting multiplicities: f,, w* = 0; mi f,, w*. 

Some classes of integrals can be immediately evaluated. Using the two 
definitions: 


e A differential form w on a manifold M is closed if its exterior derivative 
is zero: dw = 0, 
e A cycle on a manifold M is a chain whose boundary is equal to zero, 


we have the two theorems: 


e The integral of a closed form w* over the boundary of any (k + 1)- 
dimensional chain cx; is equal to zero: That is, (ae w* = 0 if 
dw* = 0; 

e The integral of a differential over any cycle is equal to zero: That is, 
Sony, €* = 0 if Ock41 = 0. 


Example 
The two-form T = (xdz + ydz) A (ydz — y* dy) can be expanded into 


T = sydz Adz +y* dz Adz — zy’ dz A dy — y° dz A dy. 


The first term vanishes because it contains a repeated differential. Writing 
the remaining terms in standard order results in 


T=y' dyAdz+y' dz Adz — xy? dz A dy. 


Notes 

[1] As a matter of convention, the function identically equal to zero is called a 
p-form for every p. 

[2] Stokes’ formula can be stated as Soc” = f dw, where c is the (k + 1)- 
dimensional chain on a manifold M and w is any k-form on M. 
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18. Feynman Diagrams 


Applicable to | Feynman diagrams are used to denote a collection of 
ordinary or path integrals. 


Idea 
Some integrals equations have a “natural” expansion scheme in terms 
of integrals. The diagrams are used to keep track of the terms. 


Procedure 

If a given differential equation is only a “small” perturbation from 
a linear differential equation (with a known Green’s function), then we 
may obtain an equivalent integral equation. This integral equation may be 
expanded methodically into a series of integrals. Diagrams are often used 
to keep track of the terms. 


Example 
Consider the nonlinear ordinary differential equation 


= = f(t) + o(t)2?, 
2(0) =0. 


in which the nonlinear term (i.e., the g(t) function) is “small.” This 
equation may be directly integrated to obtain 


t 
0 


a(t) = | f(r)dr + | g(r)z?(r) dr. (18.1) 
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— — H(t-rT) 

x 
.— 4 x — [ima 
— J scryar 


Figure 18.1 Rules for creating diagrams and rules for interpreting diagrams. 


If the value of z(t) from the left hand side of (18.1) is used in the right 
hand side, then 


a(t) = [ “f(r dr + i “g(r) | i ; f(n)an| ae 


+f g(T) im fn)an| rm o(ra)2%(ra) dr dr (18.2) 
f ae nn 9(r2)2"(r2) an “ae 


A “natural” perturbation expansion would be to keep the first two 
terms in the right hand side of (18.2), and assume that the last two terms 
are “small”. If |z(t)| < 1 then this may well be the case since the last two 
terms involve |z|* while the first two terms involve constants. 

A functional iteration technique can be used to derive (18.2) and its 
higher order extensions from diagrams. We need two sets of rules: One 
set of rules describes how the diagrams may be computed; the other set 
of rules describes how the diagrams are to be turned into mathematical 
expressions. If we use the rules in Figure 18.1, (where H() denotes the 
Heaviside function), then the first two steps in the diagrammatic solution 
to z(t) (from (18.1)) are given by the diagrams in Figure 18.2. 

Note that the third and fourth diagrams in Figure 18.2 represent the 
same mathematical expression since they are topologically equivalent. The 
purpose of the Heaviside function is to restrict the range of integration. By 
careful inspection, the mathematical expressions associated with the last 
set of diagrams will be seen to be identical to (18.2). See Zwillinger [5] for 
more details. 
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ze 
_? 4+! 1 
T2 
T T: 
_ t 4¢ 1 4+ 1 
T2 
T T 
+t 1 +t 1 
72 T2 


Figure 18.2 Two steps in the diagrammatic expansion of (18.1). 


Notes 


[1] 


[2] 


Often an “algebra of diagrams” is created, so that diagrams can be added, 
subtracted and multiplied without recourse to the mathematical expression 
that each diagram represents. This would require amplification of the rules 
that were used in the example. 

This technique is particularly important in problems in which there is no 
“small” parameter. In these cases, the formally correct diagrammatic expan- 
sion may be algebraically approximated by exactly summing certain classes 
of diagrams. See Mattuck [4] for details. 
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19. Finite Part of Integrals 


Applicable to Divergent integrals. 


Yields 
A convergent expression. 


Idea 
Many divergent integrals diverge in a common way. By removing the 
diverging piece of an integral, a finite term is left. 


Procedure 
Given the integral 


b 
I= / (x — a)" f(x) dz, (19.1) 


we assume that f(a) # 0 and —1 < A < 0. Clearly, this integral diverges 
for all integral value of n. 

However, when f € C"(s,r] and A # 0, we define the finite part of I 
to be the value of 


tat 


b 
lim / (2 — a)*~" f(x) dz — g(t)(t - apne : (19.2) 


where g(t) is any function in C"[s,r] such that the above limit exists. 


Denote the finite part of the integral J by f (x — a)*—" f(x) dx. The limit 
in (19.2) can be explicitly evaluated to find (for A 4 0): 


b n—1 4(k) A—n+k+1 

bs f**"(a)(b — a) 
(x —a)*-" f(x) dz = ) a EE 
f <4 (A—n+k+ Dk a8) 


1 ip cae n—1 ¢(n) 
+ ———. r-a Ir = dy dz. 
(n—1) wS ) s y)" f(y) dy 
For A = 0 we find: 


5 P= a) HM oat = ay f-V(a) 


b 
f ena) fa) de= (—n+k+1)k! (n - 1)! 


k=0 


b =z 
ia 2 7 i (a — a)- | (x — y)—1 f(y) dy de. 
° ' (19.4) 
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Some special cases are easy to express in terms of a Cauchy principal 
value type limit. For example, if w(x) is a non-negative weight function 
integrable on the interval (a,b), c is in the interval (a,b), and f(x) is dif- 
ferentiable in a neighborhood of c with its derivative satisfying a Lipschitz 
condition, then (see Paget [8]) 


wete) 2) ae = tim |( i. +f wef) gy wes| . 
wt +e z—C 
(19.5) 


Example 


xz 
Consider the finite-part integral J = f dy. This can be written 


Jz {ee #0) = uF) 4, + Hof ay yy oft 4 dy 


For finite-part ete we have the usual relations 


Bi zr 
dy = _i and f dy = log x. (19.6) 
0 ¥ z o Y 


Combining these results, and assuming that f(y) possesses a continuous 
second derivative on the interval [0,z], we have 


: — f(0)—yf'(0 0 
pa [LDIF gy 114 peopoge, 09.7 


Notes 
[1] This is also called Hadamard’s finite part of an integral. 
[2] The finite parts of integrals have different properties from usual integrals. 
Some of these properties are (from Davis and Rabinowitz (2]): 
(A) # is a consistent extension of the concept of regular integrals. 
(B) f is additive with respect to the union of integration intervals and is 
invariant with respect to translation. 
(C) f is a continuous linear functional of the integrand. 
(D) fy * “*dz =O0ifa>1. 
(E) fix z—' dx = 0 (this is consistent with (19.6)). 
(F) For a > 1, we have f x-“dz =1/(1—a) < 0. Hence, if f(x) > 0, it 
may be that f f(z) dz < 0. 
[3] Kutt [7] has derived quadrature rules for the evaluation of finite-part inte- 


zr 


grals of the form f oar) dz, when s € (a,b) and k = 1,2,. 
a 


20. 


[4] 


[5] 


[6] 


[7] 
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It is possible to write some finite-part integrals as derivatives of principal- 
value integrals. For example: 


> w(x)f(z) , _ df? w(z)f(z) 
wD) ae = of Togs dz. 


This is the basis for the numerical technique in Paget (8]. 
Davis and Rabinowitz [2] give the example 


1 -2 
ce ee ee 2v5 [log (1010 — 30) — 1] — v2 
0 V(y—-2)?+1 25 5 
Other classes of finite-part integrals also exist. For example, there are 

theories developed for each of the integrals 


b m b 
f(e)log™(t=2) gy an f Se) ag 

. (x — a)” a sin” “(xz —a) 
where m is a positive integer. 


Finite part integrals arise naturally in fluid mechanics, solid mechanics, and 
electromagnetic theory. See, for example, Ioakimidis [4]. 
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20. Fractional Integration 


Applicable to Fractional integrals. 
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Procedure 
The Riemann-Liouville fractional derivative of order v is defined by 


ad "f 


d(z —e)-* = Dzf(z) = 


1 / * = 
—~ xz —t)”* f(t) dt. (20.1) 
To) J. (x — t) ) 
(This is sometimes represented by ,J?.) The fractional derivative has the 
following properties: 


(1] The operation of order zero leaves a function unchanged: ,D° f(z) = 
f(z). 

[2] The law of exponents for integration of arbitrary order holds: .D? .D% 
f(z) = .D¥*” f(z). 

[3] The fractional operator is linear: .D*¥[af(x) + bg(x)] = a D2 f(r) + 
b.D%g(x) (assuming, for v < 0, that f and g are analytic). 

[4] The operation .D® f(x) yields f‘)(zx), the v-th derivative of f, when 
v is a positive integer. If v is a negative integer, say v = —n, then 

Dz" f(x) is the same as the ordinary n-fold integration of f(z). (The 

integration constants are chosen so that .DZ"f(zx) vanishes, along 
with its first n — 1 derivatives, at x = c.) 

[5] If f(z) is an analytic function of the complex variable z, the function 
¢D? f(z) is an analytic function of v and z. 


Many common functions can be written as fractional integrals of other 
functions. For example, we find 


Jp (Vu) = a Dz(e+1/2) (=x) 


2F) (a, b; g; 2) = ea p;‘s~*) (c’(1 -x)~*). 


It is also possible to represent some ordinary integrals as fractional 
integrals in non-obvious ways. For example, from Oldham and Spanier {3] 
we have (page 182) 


1/p 


ie mee de=r(2**)s -1/p d~ 1/P f 
0 p 


da—l/P 


or, when z = 1 


i (1-2) dz =r (244) SOS 


p dx—1/P 


z=1 
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For example, we find 


[ sin (vi-2) dz =T (5) i sin (/z) 


2/ dz~ z=1 


= .69122984.... 


Notes 

[1] A semi-integral is a half integral, that is v = —} in (20.1). Table 20 contains 
a short table of semi-integrals. 

[2] Another definition of a fractional derivative is Weyl’s integral 


v 1 ~”° v-l 
Ke = ao | (¢— 2)" (6) at 


for v > 0. To compute fractional integrals, let m be the smallest positive 
integer such that v < m and define r = m — v. Then 


Kz = < (x | (t— 2)" F(t) it) 


Note that we also have 


Dz" = ae (5 / (x — t)"7? f(t) it) 


when m is the smallest positive integer such that v < m and r = m-— v. 
[3] Osler [4] has established the fractional integral generalization of Leibniz’s 


rule: 
dlfg) [f° f q \dtt fag a 
dt A+y) dat de™ 


where ¥ is arbitrary. 


—o 
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Table 20. A short table of semi-integrals. 


qr? 
: a 
0 0 
C, a constant 2C = 
gl? Jr 
4272/3 

x 30n 

oe (nl)?(42)"0? 
zr, n= 0, 1, 2, “(Qn +1)l/n 
2’, p>-l ene 

iF z+ Stee 4) 

= - = arctan (Vz) 
sae. 2sinh~* (/z) 
ia “Vas 
e* e* erf (Vz) 
e” erf (Vz) e7 -1 
sin (Vz) frrJy (Vz) 
cos (v2) Vis (v2) 
sinh (Vz) Vrzh (Vz) 
cosh (/z) VrrL_1 (Vz) 

in (/z 
we ViHo (Vz) 
solve) vido (v2) 
log x 2/= flog(4x) — 2] 
log z x 
VE vee (7) 
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21. Liouville Theory 


Applicable to Indefinite one-dimensional integrals. 


Yields 
Knowledge of whether the integral can be integrated in closed form in 
terms of “elementary functions.” 


Idea 
The elementary functions are defined to be 


[1] rational functions, 

[2] algebraic functions (explicit and implicit), 

(3] exponential and logarithmic functions, 

[4] functions generated by a finite combination of the preceding classes. 


The derivative of an elementary function is an elementary function. 
The question that Liouville addressed is: “When is the integral of an 
elementary function an elementary function?” 


Procedure 
The theory underlying the evaluation of integrals is complex. We need 
the following definitions: 


e Let K bea field of functions. The function @ is an elementary generator 
over K if 
— @ is algebraic over K, i.e., @ satisfies a polynomial equation with 
coefficients in K; 
— @is an exponential over K, i.e., there is a ¢ in K such that 0’ = ¢’8, 
which is an algebraic way of saying that 0 = exp¢; 
— 6 is a logarithm over K, i.e., there is a ¢ in K such that 6’ = ¢'/¢, 
which is an algebraic way of saying that 6 = log ¢. 

e Let K bea field of functions. An over-field K(01,...,0,) of K is called 
a field of elementary functions over K if every 0; is an elementary 
generator over K. A function is elementary over K if it belongs to a 
field of elementary functions over K. 


Note that, with K = C (the complex numbers), trigonometric func- 
tions (and their inverses) as well as rational functions are elementary. For 
example cos z = 3 (e** + e~**). That is, the cosine function is made up of 
complex multiplications, complex exponentiations, and rational operations. 


The fundamental theorem in this area is 


Theorem: (Liouville’s principle) Let f be a function from a 
function field K. If f has an integral elementary over K, it 
has an integral of the following form: 


n 
[f=m+ So eloges, 


i=1 
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where vo belongs to K, the {v;} belong to K , an extension 
of K by a finite number of constants algebraic over K, and 
the {c;} belong to K and are constant. 


For example: 


[2] 


[2] 


[3] 


If an integral of an algebraic function y is elementary, then the integral 
must be of the form 


[vac = Ro(x) + » cx log Ry (xr) 
k 


where the {R,} are all rational functions and the number of terms in 
the sum is finite but undetermined. 

If y is given by the solution of an Nth-degree polynomial equation, 
and the integral of y is purely algebraic, then the integral must be of 


the form 
N-1 
[vac = >> Ry (x)y* 
k=1 


where the {Rx} are all rational functions. 

If the integral I = f fe% dz is elementary, and f and g are elementary, 
then I is of the form J = Re9, where R is a rational function of z, f, 
and g. 


Risch proved an extension to the above theorem that incorporates 


logarithms and exponentials: 


Theorem: (Risch) Let K = C(2, 01, 02,...,9n) be a field of 
functions, where C is a field of constants and each 9; is a loga- 
rithm or an exponential of an element of C(x, 01, 02,...,6i-1) 
and is transcendental over C(, 61, 62,...,0:-1). Moreover, 
the field of constants of K must be C. There is an algorithm 
which, given an element f of K, either gives an elementary 
function over K that is the integral of f or proves that f has 
no elementary integral over K. 


Davenport proved an extension to the above theorem that incorporates 


some algebraic functions: 


Theorem: (Davenport) Let K = C(z, y, 01, 02,-..,9n) bea 
field of functions, where C is a field of constants, y is algebraic 
over C(x), and each 6; is a logarithm or an exponential of an 
element of C(z, y, 61, 62,...,6;-1), and is transcendental over 
C(x, y, 61, 02,...,8:-1). Moreover, the field of constants of 
K must be C. There is an algorithm that, given an element 
f of K, either gives an elementary function over K that is 
the integral of f or proves that f has no elementary integral 
over K. 
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There is, as yet, no theorem that will allow algebraic extensions that 
depend on logarithms or exponential functions. Note that the theorems 
above are for integrating elementary functions when the integrals also have 
to be elementary. There are two ways of expanding the above results: 


e Allow a larger or different class of functions to appear in the integrand 
(in this case the class of functions allowed in the evaluated integral 
may be the same or different). 

e Allow a larger or different class of functions to appear in the eval- 
uated integral, such as those created from elementary functions and 
logarithmic integrals, error functions, or dilogarithms. 


See Baddoura [1], Cherry [3] and [4], and Davenport, Siret, and Tournier [6] 
for details. 


Example 1 

Using the above statements, we can resolve the question “Is the integral 
I=f e*’ /x dx elementary?” If it is, then by statement number 3 (above), 
the integral must be of the form J = Re®’ where R is a rational function 
of z, z~}, and x?. That is, R is a rational function of z. Equating the two 
expressions for J, and differentiating, results in 


x? 


— = Re* +22Re® or z(R’ + 2zR) =1. (21.1) 


Since FR is a rational function of 2, it can be written in the form R = 
N(x)/D(x), where N(x) is a polynomial of degree n and D(z) is a polyno- 
mial of degree d. Evaluating the differential equation for R in (21.1), using 
N and D, results in 


tDN' —xD'N + 2z7ND = D?. (21.2) 


Each term in this equation is a polynomial, the degrees of the terms are 
d+n,d+n,d+n+2, and 2d. The first two terms in (21.2) cannot 
equal each other unless N = D (which implies that R is a constant, which 
does not work). Clearly, the third term cannot have same degree as the 
first term. The fourth term cannot balance both the first and third terms, 
so no values of n and d will work. We conclude that J does not have an 
elementary integral. 
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Example 2 

As another application of statement number 3, we investigate the 
integral I = f e~* dz. If this integral is elementary, then the integral must 
be of the form J = Re-*’ where R is a rational function of x. Equating 
the two expressions for J and differentiating results in 


e* = Rle-™ + Re~* (22). 


This can be written as 1 = R’ — 2Rxr. If we write R(x) = P(x)/Q(z), 
where P(x) and Q(z) are relatively prime polynomials, then we obtain the 
relation 

Q(Q — P' + 2xP) = -PQ'. (21.3) 


Q(x) must have at least one root, 8. Hence, Q(x) can be written in the 
form Q(x) = (x—)'T(zx), where r is a positive integer and T(G) # 0. Since 
Q and P are relatively prime, P(@) 4 0. Now we have a contradiction: 6 
is a root of the left-hand side of (21.3), with a multiplicity of at least r, but 
B is a root of the right-hand side of (21.3), with a multiplicity of at most 
r—1. Hence, the assumption that f e~* dr has an elementary integral 
must be incorrect. 


Example 3 : 
Consider the integral J = [ xe~* dx. Assuming the integral has the 


form I = Re-*’ results in the following differential equation: R’—22R =z. 
This has the solution R = —$; so f xe~* dx is integrable. 


Notes 

{1] The symbolic computer language MAPLE will optionally, in the course of 
trying to evaluate an indefinite integral, print out information similar to the 
steps in the above examples. This makes it easy to monitor the computation 
and verify the result. 

[2] The integration procedures described in this section are actually used in 
computer languages that can perform indefinite integration. See the section 
beginning on page 117. 

(3] Even if an indefinite integral is not elementary, it sometimes possible to 
evaluate a definite integral with the same integrand. For example, even 
though f e~* dz is not elementary (see Example 2), the definite integral 


ne e~* dz is easily shown to be equal to \/m (see for example, page 115). 


[4] Sometimes, in practice, it seems as if most integrals of interest are not 
elementary. It is certainly true that many simple-looking integrals are 


not elementary, such as / aes, / se de, fsinz? dz, [ Vsinz dz, and 
log x zr 
f v1 — 2% dz. 
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22. Mean Value Theorems 


Applicable to Single and multiple integrals. 
Yields 


Information about a function integrated over a region. 
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Idea 
The integral of a function can sometimes be written as some value of 
that function times the integral of a simplier function. 


Procedure 
There are several theorems that yield information about the mean 
value of a quantity; we indicate only a few of them. 


First Mean Value Formula 


Assuming that a < b, we have 


b 
(aie s / f(x) dx > (b— 0) fos. 


If f(z) is continuous then we have 


b 
| f(z) dx = (b— 0) f(), (22.1) 


where a<Z <b. 


This theorem is sometimes written as (assuming, again, that f(z) is con- 
tinuous) 


b b 
[ te@ateyar = 18) [ o(c) az. 


Second Mean Value Formula 


If f is a decreasing positive function on [a,b], and g an 
integrable function on this interval, then 


b zx 
[# [ 4. 


Mean Value Theorem for Double Integrals 


< f(a) sup 
asz<b 


If f(x,y) is continuous on a compact region R, with area A, 
there exists a point (¢,7) in the interior or R such that 


} fay) dA = f(Cn)A. (22.2) 


R 
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Example 

Consider the integral J = [> xsinxdz. The exact evaluation is J = 
sin x — zcosz|° = 7. From (22.1), we can write J = mZsinZ, for at least 
one value of £ in the range [0,7]. In this case, we find that ¢ = 1.1141 is 
one such value. 


Notes 
[1] There are two theorems that are also called the second mean value theorems 
(see Gradshteyn and Ryzhik [2], page 211): 


(A) If f(z) is monotonic and non-negative in the interval (a,b) (with a < b), 
and if g(x) is integrable over that interval, then there exists at least 
one point ¢ in the interval such that 


b < 
/ POV OT Aen IG. | ae 


(B) If, in addition to the requirements in the last statement, f(z) is non- 
decreasing, then there exists at least one point ¢ in the interval such 
that 


b b 
/ f(z)g9(xz) dz = f(b) / g(x) dz. 
¢ 


[2] There is also a mean value theorem from complex analysis (see Iyanaga and 
Kawada [3], page 624): 


Let u be a harmonic function (i.e., V?u = 0), let D be the 
domain of definition of u, and let S be the boundary of D. 
Then the mean value of u on the surface or the interior of 
any ball in D is equal to the value of u at the center of the 
ball. That is 


u(P)= ty | udr =, | udo. 
TaT JB(Pr) Ont S(P,r) 


where T, and o,, are the volume and surface area of a unit 
ball in R”, B(P,r) is the open ball with center at P and 
radius r, S(P,r) is the spherical surface with center at P and 
radius r, dr is the volume element, and do is an element of 
surface area. 
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23. Path Integrals 


Idea 

Path integrals are integrals of functionals. Feynman path integrals are 
specific path integrals for the propagator of the Schrédinger equation; they 
have the form G = f e'5/", where S is the action. 


Procedure 1 
We illustrate the general procedure by considering a specific case. 
Consider a collection of particles that perform Brownian motion in 
one dimension and do not interact with one another. Define c(z,t) dz to 
be the number (or concentration) of particles in an interval of size dx about 
the point x at time t. It is well known that the concentration satisfies the 
partial differential equation 


is Daa (23.1) 
where D is the diffusion coefficient. 

If one particle starts out at zo at time tp, then the concentration has 
the initial condition c(zo, to) = 6(t—to). (The function 6() denotes Dirac’s 
delta function.) The solution of (23.1) with this initial condition is (see 
Zwillinger (11]): 


1 _ (z- 20)’ 
V4mD(t — to) ox 4D(t — to) ey 


This gives the likelihood of finding the particle at the point z at 
any time t > f9. The likelihood of finding the particle near x, with an 
uncertainty of dz, is just c(z,t)dz. (In mathematics books, c(x,¢) would 
be called the Green’s function of (23.1); in physics books it would be called 
the propagator of a Brownian particle.) 

Now divide the interval (to,¢) into N + 1 equal intervals of length e: 
t1 < te <... < ty (so that ¢;4; — t; = €). We would like to know the 
probability that the particle that started at (zo, ) is near the point 2, 
(with uncertainty dz,) at time ¢,, near the point x2 (with uncertainty dz2) 
at time f2,..., near the point zy (with uncertainty dry) at time ty, and 
near the point z := zy4,1 (with uncertainty dr) at time ¢ := ty41. See 
Figure 23. Because the Brownian particle is memoryless, this probability 
is equal to the product of (23.2) taken over successive subintervals: 


ce(z,t) = 


‘ N+1 1 i (ei 2)? | XH? 
Prob = | ———————— ex = ——— ) so dx;. 
(=a) F 4D 520 E I 4 


(23.3) 
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BOm ct VOO— 


tf to = tg t time 
Figure 23. A graphical illustration of the locational constraints on the particle. 


If the limit of infinite discretization is taken (ie.. ¢ — 0 and N — oo, 
while (N + l)e = ¢ — to), then (23.3) can be interpreted as the probability 
that the particle follows a particular path z(7) from (Zo, to) to (x, t), where 
x(7;) = z;. Jn this limit, the exponential in (23.3) can be written in the 


compact form: 
1 ft (dz\? 
e035 | (=) irk, (23.4) 


Using (23.4) in (23.3) we obtain the path integral 


ae 1 ft (dz\? 
Prob = = e035 ie @ dr > d{x(r)]. (23.5) 


The value of this path integral is, however, given in (23.2): 
1 { (x — 29)? } 
——————. exp{ — ———— >. 
/4nD(t — to) 4D(t — to) 
Note that the particular path taken, z(7), does not enter into the path 
integral in (23.5). This is because the integral is considering all possible 
paths from the initial point to the final point. 
It is worth emphasizing that (23.5) is only a notational way to indicate 


the limit of a discrete number of integrations. The terms in (23.5) can be 
individually interpreted as follows: 


Prob = (23.6) 


(A) The symbol d[z(r)] denotes 1 dz; and restricts the x(r) appearing 
in the integral to be constrained by z(to) = 20; 2; < 2(t;) < 2; +dz; 
(for j = 1,2,...,N); and z(ty41) = z(t) = x. These limits for the 
z(r) function are indicated by the limits on the first integral sign. 

(B) Each dz; is to be integrated from —oo to oo, and an implicit normal- 
ization factor is present 


[te = (so) i dz, [aa [ dzn, 


where € = (tj41 = t;)/N. 
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(C) The exponent in (23.5) is to be interpreted as 


N 
[ (2) easy eer 
to \@T é € 
j=0 


(D) After all the integrations have been performed, the limit N — oo 
(which corresponds to e — 0) must be taken. 


Procedure 2 

Consider a classical system that starts in state r+, at time t, and ends 
in state x, at time t,. The evolution of the system can be described by a 
set of variables that are functions of time; these variables describe a “path” 
from state zg to state x,. The classical system will almost certainly have 
a Lagrangian L that depends on the path of the system L = L[path]. The 
action S is defined as the time integral of the Lagrangian 


S{path] = i ” Tfpath] dt. (23.7) 


In quantum mechanics, the wave function # evolves according to #(b) = 
f P(b | a)(a) dz, where P(b | a) is the propagator from xq to xy. The 
propagator can be obtained by solving the Schrédinger equation 7hP; = 
HP, where H is the Hamiltonian and f denotes Planck’s constant divided 
by 2x. The propagator can also be obtained by the Feynman path integral 


P(b| a) = / 7 exp{ £ [path] } d{path]. (23.8) 


This second method of obtaining the propagator is more useful in some 
circumstances, such as in dissipative systems that have a Lagrangian but 
not a Hamiltonian. See Wiegel [9] for more details. The path differen- 
tial measure takes the form d[path] —> Ayn 0 ata dx;, where Ay is an 
appropriate normalization constant. 
Example 1 

We indicate two ways in which the integral 


0,t 1 t (de 2 
r= fab : (F) ark d{x(r)} (23.9) 


may be evaluated. This integral is the one in (23.5), with z9 = z = tp) = 0, 
but here we presume that we do not know its value. The integral in (23.9) 
can be written, by the four rules given above, as 


1 N+1 fore] fore) fore) 
I= lim / do | day--- | dz 
N—-00 (z=) —00 : —0o : -—0o ‘ 
N 


; (23.10) 
2 
xX exp ape 2, se —2Z;) : 
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where ¢ is related to N by ¢ = t/(N + 1). 


Example 1.A 
The quadratic terms appearing in the exponent in (23.10) can be 
written as (note that ro = 0 and zy41 = c = 0) 


Des —2;)° = > reMcy Li, (23.11) 


kl=1 


where M(%) is the tri-diagonal matrix 


2 =1 0 
~1 2 -1 
Men « “12-1 
12 <1 
0 =i, 22 


It is straightforward to show that detM(%) = N+1. Since MO) is 
Hermitian, its eigenvalues are real. see its eigenvalues by {A;}, the 
sum in (23.11) may be written as a ie 59}; where the {y;} are linearly 


related to the {z;}. Again, since M () is Hermitian, the Jacobian of this 
transformation is unity. Hence, (23.10) may be written as 


1 N+1 
= km, ( ==) i “1 ay is ayn 


N 
2 =0 


(23.12) 


= im, ( 1 Tl 4nDe 
N00 \ /4nDe ja Aj 


1 1 1 
= lm | —————— | = lim (==) a ae 
N00 (- /4n De det =a] N-oo \ V4r Dt 4n Dt 


This is precisely the value in (23.6), when x = 2p = tp = O. 
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Example 1.B 
The integrations in (23.10) can also be performed one at a time. The 
formula 


oo 
—a(ex—x2_)?—b(x—2zy)? _ us ab _ 2 
[se dz (er{- prea Lu) 


can be used to evaluate the integrals sequentially. First, choose ry, = Zo, 
x = £;, and zy = rg. Then the 2;-integral appearing in (23.10) can be 


evaluated to obtain 
fo) _ 2 _ 2 
expj ~“Gi= So) ea | de, 


Tins 
_ 5, xp{ - =o 


This expression has the same form as a term in (23.10), but with 
€ replaced by 2e throughout. Now the integration with respect to x3 is 
carried out, using zy = Z2 and xy = 2x4. Then the integrations with 


respect to 25, £7, ..., are carried out. The variables left at this point are 
{Z0, T2,24,26,-- }. 
Now the integrals with respect to x2, 2g, 19, ..., are carried out, and 


again the same form is obtained, but now 2e has been replaced by 4e. This 
operation is recursively applied. (Without loss of generality, we can assume 
that N +1 is a power of two.) The end result is 


. 1 1 

l= in —_—— = ———.. 
N-00 ,/4nD(N + lye An Dt 
Notes 


[1] The main task of evaluating a path integral is to evaluate the multiple 

Riemann integrals and then take the N — oo limit. This is only possible in 
a few cases, such as when 

e the integrals involved are Gaussians or 

e a recursive formula is available to carry out the successive integrations. 
The propagators for a free particle and for the harmonic oscillator of constant 
frequency fall in the first category. We quote here the standard propagators: 

e For a free particle of mass m 


P(b| a) = (sta) {san ~ Fa) I, 


where T = ty — tg. 
e For a free particle of mass m and frequency w 
mw 3/2 imu 
Plo) = (getter) "exo i (lf + 28lcosu ~ 204-20) 
(>| a) 2rth sin wT exp 2hsinwT ([z6 + tq] coswT — 2a wa) 
[2] When a Feynman path integral is constructed, the action is rewritten, using 
the principle of canonical quantization, with the substitutions 


q->G=q popa-ind, 
oq 


where gq is a generalized coordinate, and p is a conjugate momentum. 


23. 


[3] 


[4] 


[5] 


[6] 
[7] 
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When L = L(x, x,t), the action functional in (23.7) can be discretized using 
the midpoint rule to obtain 


N 
= Xj t+Xj-1 Xj —Xj-1 . ) 
Sn[x] =e ee ade): 
j= 


For general L, the midpoint rule is required for the propagator as given 
by (23.8) to satisfy Schrédinger’s equation. However, in some cases, other 
formulas for the derivatives may be used, see Khandekar and Lawande [4]. 
When the classical Lagrangian has no explicit time dependence, the propa- 
gator can be written in the form 


P(b| a) = Deol Haat) | $5 (ta)n (20), 


where the {E£,} and the {¢x} are the complete set of energy eigenvalues and 
eigenfunctions: H¢@, = E,¢,. This expansion is known as the Feynman—Kac 
expansion theorem. 

Note the oscillatory nature of the integral in (23.8) for small kh. From 
the stationary phase technique (see page 226) it is clear that the major 
contributor to the propagator comes from paths for which 6S = 0 and 
6°S > 0. The equation 6S = 0 is Hamilton’s principle; its solution is the 
classical path of the system. This equation is also equivalent to the usual 
Euler-Lagrange equations. If the integrand is expanded about the classical 
path, and terms out to second order are kept, then the resultant propagator 
is equivalent to the WKB approximation of the Euler-Lagrange equations 
(see Zwillinger {11]). 

Example 1.B has the rudiments of a renormalization group calculation, see 
Zwillinger (11]. 

Other terms used for path integrals are Feynman path integrals and func- 
tional integrals. 
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24. Principal Value Integrals 


Applicable to A formally divergent definite integral. 


Yields 
A convergent integral. 


Idea 

Many integrals are improper because of the limiting process involved. 
By restricting the way limits are taken in a definite integral, a convergent 
expression may sometimes be obtained. 


Procedure 
Suppose that f(z) has the singular point z in the interval (a,6), and 
suppose that f(x) is integrable everywhere in the interval, except at the 


point z. By definition (see page 53), the integral i f(z) dx has the value 


lim [swat | . itayaeh | (24.1) 


where the limits are to be evaluated independently. If the value in (24.1) 
does not exist, but the value 


Z— b 
kim i " f(a) dz + [. f(z) ash (24.2) 


does exist, then this value is the principal value, or the Cauchy principal 
value, of the improper integral J. This is denoted J = f. f(z)dz. Using 


the relation f° = f +f, , we can define the principal value of an integral 
with multiple singularities. 
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Example 
Consider the integral J = fo dz/(x—1). Because of the singularity at 


z = 1, this is an improper integral. Hence, J does not exist in the usual 
sense. However, J does have a principal value which is easy to determine: 


3 dx ; ‘ie dx 3 dz 
= lim + 
0 ©£-1 = 170 (Jo z—1 eee eae 
3 
= lim ¢ log |z — 1| 
nf 0 . 


1-+¥ 
= lim, { (toe ly| - log!) + (tog 2 — log il) } 


+ log |x — 1] 
= lim {log 2} = log 2. 


Notes 
[1] Suppose that f(x) is continuous on the interval [a,b], and vanishes only at 
the point z in this interval. If the first and second derivatives of f exist in a 


region containing the point z, and f’(z) 4 0, then the integral / iD dr 


is improper, but exists in a principal value sense. For the example ‘presented 
above, f(z) = x—1 and f'(z) = 1. 

[2] The variables in a principal value integral may be changed under some mild 
restrictions. We have (see Davis and Rabinowitz [4], page 22): 


Theorem: If z(a@) = a and z(@) = 6, and if, on the interval 
[a, 8], 2(¢) is monotonic, z’(¢) does not vanish, and z(¢) has 
a continuous second derivative, then 


£0 4 — L" FEO 
wt-e J, 2(C)— me) 


where x = m(€). 


dC, 


[3] The integral fo f(z) dz may be written in two forms: 
(A) f°, f(z) dr =limr,—0o f°», f(z) dz + limp, 00 f.? f(a) de 


: 0 R 

(B) f%, f(z) dz = limr-oo ( So, fla)dz + f(z) ax) 

The integral i ae f(z) dz is convergent when the first set of limits converge. 
If the second formulation converges, but not the first, then the integral 
is convergent in the sense of Cauchy and it is denoted fr, f(z) dz. For 
example, if es x dz converges in the sense of Cauchy, but the integral is not 
convergent. 

[4] Davies et al. [3] defines a higher-order principal value to be given by: 


Mw =f fede = 1 f 1 de) f(z) a 


a (x - u)" ~ (n- 1)! naek (x - u) dxi™~) 
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[5] Many methods for the numerical evaluation of principal value integrals 
may be found in the references. For example, in the work by Hunter and 
Smith [7], the location of the poles do not need to be known before the 
numerical algorithm is run. 

(A) Mastroianni [10] considers numerical methods for integrals of the form 
f(z,y) 
(c@-s\y—-t)” (x) we (y) dr dy. 
(B) Rabinowitz [12] considers numerical methods for integrals of the form 
f we)Fe) dz with w(x) = (1 —27)#—1/? for 0 < p< 2. 
~1 
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25. Transforms: To a Finite Interval 


Applicable to Integrals that have an infinite limit of integration. 


Yields 
An exact reformulation. 


Idea 

Many transformations map an integral on an infinite domain to an 
integral on a finite domain. Such a transformation may be needed before 
a numerical approximation scheme is used. 


Procedure 
Given the integral 


f= | pada (25.1) 


a numerical approximation technique of the form 


N 
Tx) 0jf (x5) (25.2) 


4 


may not be appropriate because of a fundamental indeterminacy in (25.1). 
If S is any positive number, then 


r= [" fayae=s [- f(S) de. 


Hence, the region where most of the “mass” of the integrand lies may have 
been (inadvertently) scaled to be outside of the range of the {z;}. Without 
some knowledge of the shape of f(x), it may be difficult to determine 
appropriate values for N and the {z;} in (25.2). 

One approach is to transform J to a finite domain and then use a 
numerical integration scheme on the finite domain. It is generally easier to 
understand the form of an integrand on a finite domain, than it is on an 
infinite domain. 

Under the transformation ¢ = t(z), we have I = ho f (x(t) |dx /dt| dt 
(see page 109). Table 25 contains several useful transformations of (25.1). 
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Table 25. Several transformations of the integral ie f(z) dz, with an infinite 
integration range, to an integral with a finite integration range. 


t(z) z(t) = Finite interval integral 
1 
e 7 = log t _l i, f(—logt) dt 
t a 
z t 1 i ‘ f ( t ) dt 
I+z 1-t a-#? J, ° \1-t/ (1-+) 
1 
1, 1+t 1 ( re ee :) dt 
tanh x log ee aa fs 5 ee; ie 
Notes 


[1] Another useful transformation, for any positive value of S, is: 


[ f(x) dx = sf [s(st) + af (=)| dt. 


lfa 1 


b 
(2] The transformation / f(t)dt = / 2 f (5) dt, valid for ab > 0, is useful 
a 1/b 
in the two cases: 
e bc witha > 0; 
e a— —oo with b <0. 
[3] If an integral has a known power-law singularity at an endpoint, then a 
transformation can be made to remove it. For example, suppose that f(x) 
diverges as (x — a)* near x = a (where —1 < a < 0). Then we can use 


a 


b 1 (b—a)?- 
/ f(t) dt = —— | t0/A-2) £ (/O-9) 4 a) dt, 
a 0 


where b > a. If, instead, f(x) diverges as (b — x)? near « = b (where 
—1< <0), and b> a, then we can use 


b 1 (b-a)!-4 
i. f()dt= | t9/0-P) f(b O-8)) ae. 
a 


[4) The change of variables in this section can be performed analytically, or a 
numerical quadrature routine can perform the change. 
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26. ‘Transforms: 
Multidimensional Integrals 


Applicable to Definite multidimensional integrals. 


Yields 
A reformulation into a one-dimensional integral. 


Idea 
Some classes of multidimensional integrals can be written in terms of 
a single integral. 


Procedure 

The following listing contains many multidimensional integrals each 
involving a general function. These multidimensional integrals can be 
written in terms of a single integral. 


Two-Dimensional Integrals 


[wf f'(pcoshz + qcosw sinh z) sinh z dz 
0 0 


== iar (Isien p] VP? - ?) 


if p? > q? and limz—oo f(z) = 0 (see Gradshteyn and Ryzhik [2], 4.620.1, 
page 618). 


/ aw | $ (pcoshe + (gcosu + rsinw) sinh) sith d 
0 0 


_ ___ 2xf{sign p| f (Isign p/p? - @2 — r?) 
p? — gq? — 1? 


if p? > qg’+r? and limzoo f(z) = 0 (see Gradshteyn and Ryzhik [2], 4.620.2, 
page 618). 
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eae fd — gcosr dz d 
[+ (eases erons) tt 
ap sinzsiny sin z sin’ y 


~—2alsignal (Isignp) p? — gq? — 7?) 
p? — 2 — 1? 


if p? > q?+r? and limzoo f(z) = 0 (see Gradshteyn and Ryzhik [2], 4.620.3, 
page 618). 


oO oo 
: dr / f' (> cosh z cosh y + qsinh x cosh y + r sinh v) cosh y dy 
—00 —00 


= -—aisienel ((sign p] Vp? - @? — 7?) 


p? —q?—r2 


if p? > q?+r? and limz.. f(z) = 0 (see Gradshteyn and Ryzhik (2], 4.620.4, 
page 618). 


eo nT 
| dz i, f (pcosh x + qcosw sinh z) sinh? zsinw dw 
) 0 


=2 i 7 f (Isign p)V p? — q? cosh z) sinh? x dz 
0 


if limzoo f(z) = 0 (see Gradshteyn and Ryzhik [2], 4.620.5, page 619). 


2 == 
/ ji f (a2? + b’y’) drdy = al a f(x) dx 
if limz—oo f(x) = 0 (see Gradshteyn and Ryzhik [2], 4.623, page 619). 


[foveal (ee 


_ a%b? _ [a/p, | / a/p+B/q-1 
pg Bee , ay 7 


if a,b, a, 8,p,q > 0 (see Prudnikov, Brychov, and Marichev [3], 3.1.2.1, page 
565). 


1 
: [sox + by +y)aedy=2 | Vi=# 7 (to? +6? +7) at 
=1 


x? +y?<1 


if a,b > 0 and a, f, and ¥ are real (see Prudnikov, Brychov, and Marichev [3], 
3.1.2.2, page 566). 
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1 
[rernecd= [seat 
izl+llsi a. 
(see Prudnikov, Brychov, and Marichev [3], 3.1.2.3, page 566). 


1 1 Fi 
i I F(zy)(1 — 2)°"y*(1 — y)?™ de dy = B(a, 8) [ F(t)(1 — t)7*> a 
0 40 - 


if Rea > 0 and Re > 0 (see Prudnikov, Brychov, and Marichev [3], 3.1.2.4, 
page 566). 


[ [10 + by)e~?*~ dz dy 
o Jo 


1 t/ ~ t/b 
= —_———__|a the P*/* at — i t)e? a 
seg | f s(t) [10 
if a,b, p,q > 0 (see Prudnikov, Brychov, and Marichev [3], 3.1.3.1, page 567). 


/ 7 | ” Fle — ye?" de dy 
(0) 0 


Z = t = t 
= ———— te" dt + i te? i 
sera |? F(t) a] F(t) 
if p,q > 0 (see Prudnikov, Brychov, and Marichev [3], 3.1.3.2, page 567). 


co co oO 
/ | f(xy)e"?” © da dy = 2 f Ko (2 pat) f(t) dt 
o Jo 0 
if p,q > 0 (see Prudnikov, Brychov, and Marichev (3], 3.1.3.3, page 567). 


[-*) oo e P*— a zy - VT (fp + V4) co -( y+ va) 
I [ otAces?, crdy= ee | eT \VPT Va) * f(t) dt 


if p,g > 0 (see Prudnikov, Brychov, and Marichev [3], 3.1.3.4, page 567). 


Three-Dimensional Integrals 


fos) 2a T 
i ac [ aw | f (reoshs + (qcosw + rsinw) sn0 sinh ) sinh? x sin 6 dO 
0 0 0 es 
= af f (Isign p? — gq? —1? cosh 2 ) sinh? x dx 
0 


if p? > q?+r? and limz.oo. f(x) = 0 (see Gradshteyn and Ryzhik [2], 4.620.6, 
page 619). 
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co 2a " 
| dz [ dw [ f (> cosh x + [(¢cosw + r sinw) sin @ + s cosh 6] sinh :) 
0 0 0 


x sinh? z sin 6 dO 


fo 0) 
= an | f ((sign pl p? — q? —r?2 — 5? cosh x) sinh” z dz 
0 


if p? > q? +r? + 8” and limz—oo f(z) = 0 (see Gradshteyn and Ryzhik (2], 
4.620.7, page 619 or Prudnikov, Brychov, and Marichev [3], 3.2.3.4, page 
584). 


[ [  fervrrs[@+ QQ] eae 
z>0, y>0, z>0 


(2)?+(#)"+(2)" 


_ a*bc? a/p, B/4, y/r E af/p+B/qry/r—1 
par . eee an ; F(t)t a 


if a,b,c, p,q,7, @, 8,y > 0 and the integral on the right-hand side converges 
absolutely (see Prudnikov, Brychov, and Marichev [3], 3.2.2.1, page 583). 


@ pa-z pa-z—y 
i / i 2° ty?) 27? F(a + y + 2) da dy dz 
o Jo 0 


= Qa, B, Y : at+p+y—-1 
Tapa f(teetot7—! ae 


if a, a, B,y > 0 and the integral on the right-hand side converges absolutely 
(see Prudnikov, Brychov, and Marichev [3], 3.2.2.3, page 583). 


Multi-Dimensional Integrals 


Neh (Soe) T cer taty = TOS ape ae 
ys! 


This is known as the Dirichlet reduction (see Squire [6], pages 82-83). 
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[feof i (See) Tateoa 


— 


Gets ote <1 
- | RCICACIET TOR GEET Ser Ee errrerer ayy 
0 


where the stars represent convolutions (see Sivazlian [5]). 


[ scene [ g(x2) dx2--- [ ‘aan) den [ f(t) dt 
=af f(t) é av)dy) a 


(see Prudnikov, Brychov, and Marichev [3], 3.3.1.1, page 585). 


£ a1 x a2 £ an 
[ffs (=) + (2) +. = Janta... de 
R 


Pi gP2 ae UG) G) ( (2 ee, 4 Pa ; 
_-“ : In a1 a2 re 0 Oe ioe a de 
aide, Qn op (2 4 Peay 
a1 a2 
m1 >0 z2>0 oe In >0 
here FR is the region R: al a2 an 
qi q2 gn 


when the integral on the right converges absolutely (see Gradshteyn and 
Ryzhik [2], 4.635.1, page 620). 


a2 £ ar 
If fi (2) +(2) +t (2) epep aaa 


cee @)@)"B) p EBHE), 


SA a Oa p(B P44 Pe) 
a) az an 


2,1 >0 zr2>0 oe Zn >0 


where S is the region S : a a2 an 
g (2) +(2) ++ (2) a4 
qi q2 dn 


when the integral on the right converges absolutely, and the numbers q;, ai, 
and p; are positive. (see Gradshteyn and Ryzhik [2], 4.635.2, page 621). 
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gPim type) | gPn-} dy 
oie %11+22+...+2£12)-——-rOoOT 
// [a a) (qiv1 + qot2+...Qn2n + pyar en 
R 


= Ferries). Tea), f(z SS en 
I (pi + po +...+Pn) (qit +1r)"!(qoz +r)" ...(qnz +r)" 


zm,1>0, z2>0, ..., 2n2>0 


U1 +22+...¢2n 1 
tinuous on (0,1) and g; > 0 and r > 0 (see Gradshteyn and Ryzhik [2], 
4.637, page 622). 


ann? * n-1 
le 7 x? + a2 4 Vat +a3+...+28) mac xz” f(x) dx 
2 


x2 +234...+22 <R? 


where RF is the region R: { , f(z) is con- 


if f(z) is continuous on the interval (0, R) (see Gradshteyn and Ryzhik [2], 
4.642, page 623). 


1 pl 1 
/ / af f(aize...2n)(1 — 21)?!~*(1 — 22)??7?...(1 — an)??? 
o Jo 0 


x abt hits | ; garter hit Paas dx 


= P'(pi)P'(p2)..- Pn _ @\P1+P2 Pa- 
I(pit+pet.. Moa) F(a)(a — eypetpe toe" de 


when the integral on the right converges absolutely (see Gradshteyn and 
Ryzhik [2], 4.643, page 623). 


[ff Pee te 
; 1-2? -—22-...-2n-1 
_ gir 1)/2 Tv ; ; : sans 
~ “eS h f (Vet +P3 +... + ph cosz) sin” * 2 dz 
2 
if R is the region R= aj +23+...+22_, <1,n > 3, and f(z) is continu- 


ous on the interval (—6, 6], with 6 = ./p? + p? +... + p% (see Gradshteyn 
and Ryzhik [2], 4.644, page 624). 
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Notes 

[1] See also the section on how to change variables on page 109. 

[2] Schwartz [4] considers a numerical technique for integrals of the form 
Guin J 9:(z:) dz;) F (eo fi(zi)). His technique is based on the use of 
integral transforms. 
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Idea 
This section has a collection of transformations of integrals. 


Some Specific Forms for 
One-Dimensional Integrals 


When an integrand has a specific form, there are some common trans- 
formations that might be useful. For example, if the integrand: 


(A) is a rational function of sinz and cosz, introduce u = tan(x/2) 
so that 


sinz = 
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- 2 
sin* x 
For example, the integral J = / —z 7 Az becomes 
cos? x + cosz sin? x 


8u?(u? + 1) 
(u? — 1)(u? — 2u — 1)(u* + 2u® + 2u? me a a 
4u® + 6u? + 4u —2 2u — 2 1 1 
Ppt gaat. oe ) ai Sa a —-—— | du 
ue +2u°+2u°-2u+1 3(u°-2u—-1) utl u-i 


= 2 log (u* + 2u° + 2u? — 2u +1) + 4 log (3(u? — 2u — 1)) 
— log(u + 1) — log(u — 1) 


1 8u° 
= — log | 1 - ——— 
3 «( way) 
= }log (1+ tan’z). 


(B) is a rational function of sinhz and cosh z, introduce u = tanh(z/2) so 
that 


2 
sinhz = me = cosh z = we dz = coe 
l-u l-u l-wu 


(C) is a rational function of z and V/1 — z?, introduce x = cos v to get 
to case (A). 

(D) is a rational function of x and x? — 1, introduce x = coshv to 
get to case (B). 

(E) is a rational function of x and Vz? + 1, introduce u = 2+V2z? +1 
so that 


(F) is a rational function of z and Vax? + br +c, then the substitu- 


tion 
2az +b vv |4ac — b2| — b 
= = 
V |4ac — b?| 2a 
will reduce the integral to one of the above cases. 
axz+b 


(G) is a rational function of x and u = eraA then use the substi- 
tution 
ax +b b—ud 
c= a oe 
cz +d a—wu‘c 


Integrals of the form fx™(a + bz")? dx, where m, n and p are rational 
numbers, can be expressed in terms of elementary functions in each of the 
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following cases (see Gradshteyn and Ryzhik [3] 2.202, page 71): p is an 
integer; (m+ 1)/n is an integer; and p + (m+ 1)/n is an integer. 


Three useful transformations of definite integrals from Gradshteyn and 
Ryzhik [3] (3.032.1-3.032.3) are 


n/2 n/2 
‘| fisinz) de = [ f(cos x) dz 
) 0 
S(peos + qsinz) de =2 [ f (Vp? + @ cosx) dr 
0 


a /2 n/2 
/ f (sin 2x) cos x dz = | f (cos? x) cos x dz. 
0 0 


2a 


The Slobin transformation is (see Squire [6], page 95) 


‘ee (:-7) a= [sae 


The Wolstenholme transformation is (see Squire [6], page 95) 


. dt : dt 
2 
—_—= t 
[r(e+) 4 iGaoks 
Two unnamed transformations for definite integrals (from Squire [6] page 
94) are: 


[+ (sinz, cos? 2) de = 5 f f (sinz, cos? x) dx 
0 

fos) -1 1 

i f(a" + a a= 5 | f(o™ +077) =. 
0 2 0 zt 


Dealing with Singularities 


Often, integrable singularities can cause a numerical routine to have 
trouble approximating an integral. While there are no universal principles 
to be applied, some simple techniques can be useful. 


1 
Consider the integral J = / ue dx. Assuming that f(0) is finite, 
x 


0 
I has an integrable singularity. But a computer routine evaluating this 
integrand near z = 0 may have trouble. 
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(A) If the f(z) term was not present, then we would note the indefinite 
integral f dx//rz = 2,/x. Since the form \/x appears, it might be 
reasonable to transform the integral to be on this scale. Changing 
variables via u = \/z changes I to I = 2 ho f(u?) du. This integral no 
longer has a singularity at the origin. 

(B) Another technique is to subtract out a singularity. For example, if 
f(0) has the finite value A, then J can be written as 


p= [EDA tM ae [EEA do 24 


This new integrand has more smoothness than the original integrand, 
thus should be easier to evaluate numerically. 

Another technique is to break the integral up into several sub-integrals. 
For the above integral we might try 


renth= [Bass [Qa 


where € is large enough so that a numerical routine does not have 
trouble with J;, say « = 1074. Then the integral J. has a narrow 
region of integration; expansion methods, such as Taylor series, may 
yield a good numerical approximation. 


(C 


~— 


Of course, commercial integration software can automatically detect power 
singularities, and apply an appropriate (numerical) transformation to avoid 
computational difficulties. 


Products of Special Functions 

Piquette [5] considers integrals of the form J = f f(r) [[,_, RY (x) dz, 
where RY) (x) is of the i-th type of a special function of order pz, obeying 
the set of recurrence relations 


RY), = a, (2) RO + by(x)R®,, 


dR) ; : (27.1) 
f= c,(2)RY + d,(z) Re ,. 


Here {a,,6,,¢,,d,} are known functions. Most of the special functions 

of physics, such as the Bessel functions, Legendre functions, Hermite func- 

tions, and Laguerre functions have recursion relations in the form of (27.1). 
The indefinite integral J is assumed to have the form 


1 1 1 
[= » ye a Appr. “Pm (x) TAS. 


Pi =0 p2=0 
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Then the values of the {Ap} are determined, sometimes with the help of 
a differential equation. Piquette [5] obtains, for example, the following 
integral involving Legendre functions 


[> [Pijs(z)]° dx = (42824 — i4y? -3 [Prys(x)]° 
+(—4+ 20x?) Py /3(z) [Pays(x)]° 
+ (9x — 252°) [Prys(x)]° Pyj3(x) — Sa [Pays(z)]° - 


A Jacobian of Unity 


Sometime a judicious change of variables in a multiple integral may 
make it easier to evaluate. Finding the correct change of variables may 
sometimes be done by solving a partial differential equation. 

For example, changing variables in the usual way in two dimensions 
results in (see page 109) 

O(z, y) 


r= ff say)aedy= ff (u,») ae 


where F(u,v) := f (x(u, v), y(u, v)). If u is chosen so that F(u,v) = F(u), 
and v is chosen so that 

O(z,y)|  _ Oudv = Gu dv 
O(u, v) ~ Or dy Ody dx 
then (27.2) becomes IJ = ff F(u)dudv, which may be easier to integrate. 
Note that equation (27.3) for v is a partial differential equation. 


du dv, (27.2) 


= 1, (27.3) 


Example 
2 


2 p4 a? — y? 
Suppose we have the integral J = J [ vs ( a ) dz dy. Choos- 


ing u = x? —y? simplifies (27.3) to 2x — = oy = = 1 which has as a solution 


Oy 
v = $log(z + y). 
Using the u and v variables defined above, J becomes 


8 pu3(u) 12 pu3(u) 15 pva(u) u 
= i; / +/ / +/ / log — dv du, 
5 Ju (u) 8 Jue(u) 12 Jv(u) 4 
v1(u) = 4 log (3 + V9 — u) 
v2(u) = § log (1+ V1 +1) 


v3(u) = 3 log (2+ V4+ 4) 
vq(u) = 3 log (4+ V16—1u). 


It is now straightforward to evaluate this integral. 
See Morris [4] or Squire [6] pages 12-13 for details on this method. 


where 


108 II Concepts and Definitions 


Notes 

[1] If R(sinz,cosz) satisfies the relation R(sinz,cosz) = —R(-sinz,cosz) 
then it is normally convenient to make the substitution z = cosz. This 
results in the formula 


J Reins, c082) de = -[R (vi - 2,2) vers 
1l—z 
(2] If R(sinz,cosz) satisfies the relation R(sinz,cosz) = —R(sinz, —cosz) 
then it is normally convenient to make the substitution z = sinz. This 
results in the formula 


[ riins,cosa) ae = f R(z, vi-2) yer 


[3] If R(sinz,cosz) satisfies the relation R(sinz,cosz) = R(—sinz,—cosz) 
then it is normally convenient to make the substitution z = tanz. This 
results in the formula 


1 dz 
Risinz,cosz) de = | R ee 
j Grex Vi+z22) 1+2° 


For example, we find (compare to the first example in this section) 


. 2 
t= [te 
cos x£+coszsin £ 
2 
a 
(z+1)(z° —z+1) 


2z—-—1 1 
=| Peas * 341) ~ 
= flog (z’ — z +1) + $ log(z +1) 
= 4 log (1+ 2°) 
= dlog (1+ tan’ =). 
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28. Change of Variable 


Applicable to Definite integrals. 


Yields 
A reformulation. 


Idea 
A re-parameterization of an integral may make it easier to evaluate. 


Procedure 
Given the integral 


I= os f(x) dz, (28.1) 


zt=a 
if there exists a transformation of the form x = u(y), which can be uniquely 
inverted on the interval a < x < b to give y = v(z), then 


y=u(d) y=vu(b) 
I= j " Fu(y)) de = / MUM oday. (28.2) 


=v(a y=v(a) 


It is sometimes easier to evaluate (28.2) than to evaluate (28.1) directly. 
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zt U 


Figure 28.1 Pictorial representation of a mapping from the {x,y} plane to the 
{u,v} plane. 


Similar results hold in multiple dimensions. If there exists a one-to-one 
transformation from the region R in the zy-plane to the region S in the 
uv-plane, defined by the continuously differentiable functions x = x(u, v), 
y = y(u,v); and if the Jacobian 


Zu Yu 


O(z, 
ene Ot ee ae 


O(u, v) 
is nonzero in the region of interest, then 


Jf tedden = ff seotun,vamee)ldae 284) 
R s 

(see Figure 28.1.) A listing of some common two-dimensional transforma- 
tions is in Table 28.1. 

In an orthogonal coordinate system, let {a;} denote the unit vectors in 
each of the three coordinate directions, and let {u;} denote distance along 
each of these axes. The coordinate system may be designated by the metric 
coefficients {911, 922, 933}, defined by 


_ fOr, ‘ Oz : Or3 4 
Ji = () + (2) + (#2) , (28.5) 


where {x1, 22,23} represent rectangular coordinates. Using the metric 
coefficients defined in (28.5), we define g = 911922933; the magnitude of 
the Jacobian of the transformation is then given by |J| = ,/g. Moon and 
Spencer [4] list the metric coefficients for 43 different orthogonal coordinate 
systems. (These consist of 11 general systems, 21 cylindrical systems, and 
11 rotational systems.) 

Operations with orthogonal coordinate systems are sometimes written 
in terms of the {h;} functions, instead of the {g;:} terms. Here, hj = ,/9ii, 
so that |J| = \/g = hihoh3. For example, cylindrical polar coordinates are 
defined by x1 = rcos¢, rz = rsing, and z3 = z. Therefore, using {u, =r, 
ug = 6, ug = z}, we find hy = 1, ho = 7, and h3 = 1. From this we compute 
the magnitude of the Jacobian to be |J| = r. A listing of some common 
three-dimensional transformations, and their Jacobians, is in Table 28.2. 


(28.3) 
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Example 1 
Given the integral 


{2 
He [ sin £ cos £ iz (28.6) 
1+sin? x x 


we choose to change variables by z = u(y) = sin7} y. This function can be 
uniquely inverted (on the range 0 < x < $) via y = v(x) = sinz. Thus, 


de = u(y) dy = —SH— = Y= 


1-y? Vi-sin?z cosz 


This could also have been obtained directly by dy = vu'(x) dx = cos dz. 
Our change of variable then permits (28.6) to be written as 


y=l d y=l y=l 
ref a y -[ —Y ody = = = log(1 + 9”) = log2. 

y=o 1+y* cosz y=0 1+y’ y=0 
(28.7) 


Example 2 

Consider the integral J = {5 x? dx. If we choose to change variables 
by y = u(x) = x”, then we note that v(x) cannot be uniquely inverted on 
the given interval of integration. Hence, we must break up the integral I 
into pieces, with v(x) uniquely invertible on each piece. If we write J as 


0 1 
I=h+h= | ods + | x dz, 
0 


-1 


then we can use the enange of variables {y = x”, cx = —/y} on I, and the 
change of variables {y = x?, + = \/y} on Iz to obtain 


ne [eee [rot t 50-4 (37)] 


1 
0 3 


and 
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Figure 28.2 The region of integration for Example 2, and the results of the 
coordinate transformation u=2+y, v= 2 — 2y. 


Example 3 
Suppose we wish to evaluate the integral J = f f (x+y)? dx dy where 


R 
R is the parallelogram shown in Figure 28.2. The sides of R are straight 
lines with equations of the form 


rt+y=Cc, xr — 2y = Co, 


with the values c; = 1, c; = 4, cp = —2, and cp = 1. If we introduce the 
new coordinates 
u=xrt+y, v=x2—2D2y 


then the region A corresponds to the rectangle 1 < u< 4, -2<vu< 1. 
This mapping is clearly one-to-one, and the Jacobian is given by 


~%y 2 1 2 1 Li} 
~ Ouv) Ourv) fr af 3 
O(a, y) 1 -2 


Therefore, we find 
4 pl 4 fl 42 
r= | / (c+y)*\Jldvdu= ff — dvdu = 21. 
1 J-2 1 J-2 3 


Table 28.1 Some common two-dimensional transformations. 


Or Brja 
| dz i fewee 
0 0 


B a 
if il PGgyiee 
0 


ay/B 
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Assuming that a = 6/(8 + y), a>0, 8 > 0, 7 > 0 then we have 


a 6-y2r y 
[ dz[ f(x,y) dy = 
0 


Bz i : ; 
ap y/B Son 
/ ay | f(x,y) d+ Bo |: ia 
0 0 i 


6 (6-w)/7 : 
[if seve. SS 
as 0 beatae ape pe 


0 ae 5 . 
B+ 
Note this second representation has the integral separated into two pieces. 
R VR? -22 
| dz | f(z, y) dy = 
0 0 
R VR? -y? 
| ay | f(z, y) dz = 
0 0 


n/2 R 
/ dy i, f(rcosy,rsinw)r dr. 
0 0 


[rel tena 


nf{2 Reos 
i: av | f(r cosy,r sin w)r dr. 
0 0 


Table 28.2 Some common three-dimensional transformations (see Moon and 
Spencer [4]). 


(A) Bispherical Coordinates 


_ oy, Vi- _ Va = u3)(1 = a8) _ Vui-1 
t1 = au3———",, t2 = a £3 = —— 
U1 — U2 U1 — U2 U1 — U2 


a 1— up 


a a 
ns a Ne 
(ui — u2)\fu? -1 (ui — u2)f1 — ud ui —u2 V 1-43 
(B) Cylindrical Polar Coordinates (here J = r) 
Zi =rTcos¢, Z2=rsing, r3=2 

h, = 1, ho =r, h3 = 1. 


hi = 
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2,2 
~cu 
~—*) 


2 
(C) Elliptic Cylinder Coordinates (here J = = 


x1 = Ute, Z2 = 1/(u? — c?)(1 — u2), Z3 = U3 


(D) Ellipsoidal Coordinates 
(uj - a”) (uz - a’) (uj - a”) 


a?(a’ — 6”) 


m= (uj - b”) (u3 - 6”) (uj - b”) _ U1U2U3 
~~ b?(b? — a”) pS ab 
h = (uj — uz) (ui — u3) 
‘= ae) EF) 
(uz — ut) (u2 — us) (u3 — ui) (u3 — ua) 
(uz — a”) (uz — 0°)’ (u3 — a”) (ug — 6”) 


(E) Parabolic Cylinder Coordinates (here J = u? + u2) 
— uz), Z2 = UU, T3 = U3 


hi = he = v/u? + uf, h3 = 1. 
(F) Paraboloidal Coordinates 


(ut — a”) (uz — a”) (uj - a”) 


i= 


ho = 


h3 = 


t1= 


a’ — b* 
2 72) (,2 22) 7,2 32 
wy =f ODP) gE ad tad tudo?) 


(ui — uz) (ui — ua) 


f= (ui - a”) (ui — 0b? 
(u3 — uj) (u3 — uz) _ | (ug — ui) (u3 — u2) 
(uz — a”) (uz - 8)’ (u3 — a”) (ug — 6”) 


(G) Rotational Parabolic Coordinates (here J = uiu2,/u? + u2) 
ZL) = U1U2Us, Tq = Uitie,/1 — u3, r3 = 3(uj — us) 
hy = ho = Vu? + 2, h3 = —aw. 
1-3 
(H) Rotational Prolate Spheroidal Coordinates 


mi = (QP — a) (1-28), 22 = (ul — 0?) (1) (1-08), 3 = tte 


2 2 2 
uy —a’us Ul — aus _ (uj —a ) (1-43) 
i” = 4/ ———— 


hj = 
* uj —a 1— ug 1—wug 


28. 
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(1) Rotational Oblate Spheroidal Coordinates 


Ey = ugy/ (uz + a?) (1 — 43), vo = (uz + a?) (1 — u3) (1 — v9), v3 = ures 


uj + a“uz uy + aus (uj +a”) (1 - uz) 
RS ag a Se SA 
uj +a 1—wup 1-— ug 


Notes 


[1] 


[2] 


[3] 


For spherical coordinates in n dimensions, we have the mapping {z; | i = 
1,...,n} > {r,0; [¢=1,...,n—-—1} via 

2, = rsin@; sin @2---sin@,-2 sin @n-1 

Z2 =7 sin; sin 2 ---sinOn-2 cos On-1 


23 =rsin@; sin 62 ---cosOn-2 


In-1 = 7 sin 9, cos 62 
In =7cos6;. 
Hence, the Jacobian is given by J(r, @) = (-1)"*-/2r"—! sin” —? @, sin” —* 62 


oS sin? 6n-1 sin O6n-2.- 
The following two changes of variables are frequently useful: 


B 1 
- foment h j((8 alt +0) dt 


ae (<4 *) dt 


The easiest derivation of the value of J = [~™ e-*’ dz is obtained from a 


clever change of variables. Multiplying I by itself results in 


ra ([7 ere) ([7 ers) 
5 2 2 


co 2x 
= ; i e-” rd dr 
0 Jo 
oo Z 2n 
= (/ e rér) (/ i) 
0 0 
roo 6=2n 
) 0 = 7. 
r=0 6=0 
where we have changed from rectangular coordinates to polar coordinates 


via {r? = 2? +”, tan@ = z/y}, which introduced the Jacobian J = r. From 
this we conclude that J = x. 
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[4] As Flanders [1] shows, there is another application of the transformation in 
the last note to the Fresnel integrals. Define 


F(t) = i e~*” cosa? dz, G(t) = / e~**” sing? dx 
0 0 


so that the Fresnel integrals are given by Fo = F(0) = fe cos x? dx and 
Go = G(0) = So sin x? dz . We now compute 


F(t) -—G(t) = (/ e~**” cos x? ax) (/ eY” cosy? ay) 
0 0 
fo =] co 
- (/ e-” sin x? ir) (/ e~¥” sin y" iy) 
0 0 


= / eee [cos z’ cosy” — sinz” sin y”| dz dy 


z>0,y>0 


-[ lr en (cosr*)r dr dO 


=— r_ *2 cogzdz = = 
4 ners 


2 


(28.8) 
where the substitutions z = r? = 2? + y? were used. Similarly, it is possible 


to derive that 


co oo 
2rqyct) = | / en t=?40") sin(a? + y%)dedy ==. (28.9) 
o Jo 41+t 


Taking the limit ¢ — 0 in both (28.8) and (28.9) results in the simultaneous 
equations {F5 —-GZ=0, 2FoGo= 7/4}. It is easy to show that Go > 0, 
so we conclude that Fo = Go = \/7/8. 

(5) A precise statement of when a change of variables can be performed is 
contained in the following theorem: 


Theorem: Let V be an open set of R? and wu a diffeomor- 
phism of V onto u(V) (ie., u is a bijection of V onto u(V) 
such that u and u~* are continuously differentiable). Then 
the formula 


f(x) dx = | f(u(x)) |J(%)| dx 
V 


u(V) 


is valid in each of the following two cases (see George (2], 
page 22): 

(A) f is a measurable positive arithmetic function on u(V); 
(B) f is an integrable function over V. 
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29. Computer Aided Solution 


Applicable to Indefinite or definite integrals. 


Yields 
An exact evaluation of an indefinite or definite integral. 


Idea 
Some commercial computer algebra packages include a symbolic inte- 
grator. 


Procedure 

Find an computer system that runs any of the following computer lan- 
guages: Axiom [7], Derive [2], Macsyma [4], MAPLE [1], Mathematica [8], 
or REDUCE [5]. Then learn how to use the language, and find the routine 
that symbolically evaluates integrals. 

To compare some of these different languages, a test suite of indefinite 
and definite integrals was created, and the integration routine from each 
language was run on the test suite. The indefinite integrals tested were 


i: J sina dx 12: J vtanz dr 
13: | 5 dx 14: } = de 
zs —-l1 sin” z 
log z x 
I5: 16: | ——_—"""—— dz 
Vvi+1 Vvl+z+vV1l—-c2 
I7: e73” I8: 2 dx 
J log? x 
19: if em dz 110: i Le 
x 2+ cosz 


Note that integrals I7, I8, and I9 are not elementary integrals; their evalua- 
tion depends on the error function, the exponential integral, and the cosine 
integral. Integral I10 is discussed on page 192. 

The definite integrals tested were 


4x dz ~ sing 
D1: 7 —_- D2: / — dr 
0 2+ cosz £ 


—co 
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oo e= co ve 7 
D3: D4: / ——=a; ar 
0 ae 9 1l-e 2 
D5: frre = log? x dz D6: fre e~*2° log? x dz 
co 2 
pz: | —_, dx D8: ae 
0 l+z 12 


D9: f e- #2"? de. 


Observe that none of these definite integrals, except integrals D7 and 
D8, have elementary indefinite integrals. Additionally, note also that in- 
tegral D7 is divergent. Note that integral D8, as written, is improper and 
has no well defined value. If integral D8 were written as a principle value 
integral, J = fF, z~*dz, then J = 2. A routine that evaluates definite 
integrals by first determining the indefinite integral would return this value. 


Example 1 

The following is the result of running the test suite on a 386 computer 
running Derive. In Derive the integration function has the name INT. The 
Derive results were obtained by creating an input file, running that file, and 
then storing the output. Using this procedure, each input line is followed 
by the corresponding output line. The author changed some of the output 
appearing below to make it fit on the page better. 

Derive is intended to be used interactively in a graphical mode, and 
the graphical display of the results below looks much better than the 
corresponding printed output. For example, in the graphics mode, the 
square-root function displays the square-root sign, not the function name 
SQRT. 

i1sINT(SIN(x) ,x) 

i1=-C0S (x) 


i2@INT(SQRT (TAN (x)) ,x) 

i2=SQRT (2) *ATAN (SQRT (2) *SQRT (TAN (x) ) +1) /2+SQRT (2) *ATAN (SQRT(2) * 

SQRT (TAN (x) )-1) /2-SQRT (2) #LN( (COS (x) *(SQRT (2) *SQRT (TAN (x) )+1)+SIN(x))/ 
COS (x) ) /4+SQRT (2) *LN( (SIN(x) -COS (x) * (SQRT(2) *SQRT (TAN (x) )-1)) /COS(x))/4 


i3°INT (x/(x73-1) ,x) 
i3=SQRT (3) *ATAN (SQRT (3) *(2*x+1) /3) /3-LN(x*2+x+1) /6+LN(x-1) /3 


i4eINT(x/SIN(x)°2,x) 
14sLN(SIN(x) )-x*COT (x) 


iSsINT(LOG(x) /SQRT(x+1) ,x) 
i5=-4*LN ((SQRT(x+1)-1) /SQRT (x) )+2*SQRT (x+1) *LN (x) -4*SQRT (x+1) 


i6sINT(x/ (SQRT(1+x)-SQRT(1-x)) ,x) 
16=((x+1) * (3/2) -(1-x) *(3/2))/3 


i7=INT (#e* (-a¥x°2) ,x) 
i7=SQRT (pi) *ERF (SQRT (a) *x) /(2*SQRT(a)) 


8=INT(x/LOG(x) “3,x) 
i8=-x°2/LN(x)-x°2/ (2*LN(x) ~2)+2eINT(x/LN(x) , x) 
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i9=INT(SIN(x) /x"2,x) 
i9=INT (COS (x) /x,x)-SIN (x) /x 


i110=INT(1/(2+COS(x)) ,x) 
110=-2*SQRT (3) *ATAN (SIN(x) / (COS (x) +1) ) /3+2*SQRT(3) *ATAN(SQRT (3) #SIN(x)/ 
(3* (COS (x) +1) )) /3+SQRT (3) *x/3 


di=INT(1/(2+COS(x)) ,x,0,4*pi) 
di=4*SQRT(3)*pi/3 


d2=INT(SIN(x) /x,x,-inf,inf) 
d2=INT(SIN(x)/x,x,-inf,inf) 


d3=INT (#e* (-x) /SQRT(x) ,x,0,inf) 
d3=INT (#e* (-x) /SQRT(x) ,x,0,inf) 


d4=INT (x7 2*#e* (-x)/(1-#e7 (-2*x)) ,x,0,inf) 
d4=INT (x*2*#e~x/ (#e~ (2*x)-1) ,x,0,inf) 


aSsINT (#e* (-x°2) *LOG(x)°2,x,0, inf) 
aS=INT (#e* (-x72) #LN(x)°2,x,0,inf) 


d6=INT (x*3*#e* (-x"2) *LOG(x)°2,x,1,inf) 
d6=INT (x*3*#e7 (-x°2) *LN(x)72,x,1,inf) 


d7=INT(x72/(1i+x"3) ,x,0,inf) 
d7=inf 


d8=INT(1/x°2,x,-1,1) 
d8=-2 


AaQ=INT (#e* (-x) *x* (1/3) ,x,1,inf) 

da9=INT (#e* (-x) *x* (1/3) ,x,1, inf) 

In the above the following special notation has been used: inf for co 
and #e is used to specify the base of natural logarithms e ~ 2.718. 

From the above we observe that Derive could not evaluate the following 
integrals from the test suite: D2, D3, D4, D5, D6, and D9. Derive did not 
recognize the cosine integral in I9, but left the answer in terms of this special 
function. Finally, Derive made an error on integral D8 by not identifying 
the singularity at x = 0. 


Example 2 

The following is the result of running the test suite on a SPARCstation 
running Macsyma. In Macsyma the integration function has the name 
integrate. Note that (C1), (C2), ... are input lines (“command” lines) 
and that (D1), (D2), ... are output lines (“display” lines). The symbol 
% refers to the last expression. The author changed some of the output 
appearing below to make it fit on the page better. 


(C1) I1: integrate( sin(x), x); 
(D1) - COS(X) 
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(C2) I2: integrate( sqrt(tan(x)), x); 
LOG(TAN(X) + SQRT(2) SQRT(TAN(X)) + 1) 


(D2) 2 (nm ere rn nnn n nn nnn nnn nnn nn nnensnensna=== 
4 SQRT(2) 
LOG(TAN(X) - SQRT(2) SQRT(TAN(X)) + 1) 
fo Sww wen weee nena wwe eww ew eee e ee eeeeccece 
4 SQRT(2) 
2 SQRT(TAN(X)) + SQRT(2) 2 SQRT(TAN(X)) - SQRT(2) 
ATAN(------------------------ ATAN (------------------------ ) 
SQRT(2) SQRT (2) 
een nn nn nn nnn nnn ee Herr rrr ren nnn nee na= ») 
2 SQRT(2) 2 SQRT(2) 
(C3) 13: integrate( x/(x*3-1),x); 
X+1 
LOG(X + X + 1) SQRT(3) LOG(X - 1) 
(D3) oe sem ee son eenno-- $ ceccssccn---- + coccee---- 
6 SQRT (3) 3 
(C4) 14: integrate( x/sin(x)“2, x); 
xX 
(D4) LOG(SIN(X)) - ------ 
TAN (X) 


(C6) IS: integrate( log(x)/sqrt(x+1), x); 
LOG(SQRT(X + 1) + 1) 
(D6) 2 (SQRT(X + 1) LOG(X) - 2 (- -------------------- 
2 


LOG(SQRT(X + 1) - 1) 
a ca + SQRT(X + 1))) 


(C7) I7: integrate( exp(-a*x"2), x); 
SQRT(%PI) ERF(SQRT(A) X) 
(D7) ett nnnnw nn nnnnnnnnn= 
2 SQRT(A) 


(C8) I8: integrate( x/(log(x))°3, x); 
/ 


C x 

(D8) I ------- aX 
) 3 
/ LOG (Xx) 


(C9) I6: integrate( x/(sqrt(1+x)+sqrt(1-x)),x); 
/ 


(D9) ee ax 
] SQRT(X + 1) + SQRT(1 - X) 
/ 


(C10) block({algebraic:true] ,ratsimp(first(%))); 
SQRT(1 - X) - SQRT(X + 1) 
(D10) Teter armen ww enceneencnnene 
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(C11) 


(D11) 


(C12) 


(D12) 


(C13) 


(D13) 


(C14) 


(D14) 


(C15) 


(D15) 


(C16) 


Error: 


(C17) 
(D17) 


(C18) 


(D18) 


(C19) 


(D19) 


(C20) 


(D20) 


integrate(%,x); 


3/ 
2 (X + 1) 2 (1 - X) 


SIN(X) 
2 ATAN(-------------------- ) 


SQRT (3) 
I9: integrate( sin(x)/x°2, x); 
/ 
[ SIN(X) 
I ------ dX 
] 2 
/ xX 
Di: integrate( 1/(2+cos(x)) ,x,0,4*%pi); 
4 SQRT(3) %PI 


D2: integrate( sin(x)/x,x,-inf,inf); 
“PI 


D7: integrate( x°2/(1+x°3) ,x,0,inf); 
Integral is divergent 


D3: integrate( exp(-x)/sqrt(x) ,x,0,inf); 
SQRT(ZPI) 


DS: integrate( exp(-x~2)*log(x)°2,x,0,inf) ; 
2 


SQRT(%PI) LOG (2) SQRT(%PI) “GAMMA LOG(2) 4%PI 


$ wowwwwen =~ = 
8 
D6: integrate( exp(-x)*log(x)°2*x°3,x,1,inf) ; 

INF 

/ 

C 3 -X 2 

I X 4E LOG (X) dx 

] 

/ 

1 


D9: integrate( exp(-x)*x*(1/3),x,1,inf); 
4 


GAMMA(-, 1) 
3 
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(C21) D4: uateerere. i i ea a 


SS coe + 1) 
(D21) (limit eee e en nnn-n--- - oe oz ) +X ae = ) 
X -> INF 2 


2 x 
x x X LOG(1 - %E ) 7 ZETA(3) 
* LE C= KE) oc EL Ce ZED Sees seeee = ) + ceeenen=- 
3 2 


(C22) D8: integrate( 1/x°2,x,-1,1); 

Error: Integral is divergent 

In the above the following special notation has been used: ERF for the 
error function, %GAMMA for Euler’s constant, GAMMA() for the incomplete 
gamma function, LI for the logarithmic integral of different orders, %E for 
the base of natural logarithms e, and %PI for z. 

From the above we observe that Macsyma could not evaluate the 
following integrals from the test suite: I8, 19, and D6. The result for I10 
is correct, but only for a limited range. Macsyma could evaluate integral 
16 only after the integrand was simplified. Macsyma left the result for 
integral D4 in the form of a limit. Finally, Macsyma successfully identified 
the singularity at + = 0 in integral D8. 


Example 3 

In MAPLE the integration function has the name int. The MAPLE 
results were obtained by creating an input file, running that file, and then 
storing the output. In this case all of the input is followed by all of the 
output. The author changed some of the output appearing below to make 
it fit on the page better. MAPLE is intended to be be used interactively, 
and the graphical display of the results below looks much better than the 
corresponding printed output. 


<< BREUE >> 
Ti int( sin(x), x) 


I2 := int( sqrt(tan(x)), x) 

I3 := int( x/(x73-1), x) 

I4 := int( x/sin(x)°2, x) 

IS := int( log(x)/sqrt(x+1), x) 

I6 := int( x/(sqrt(itx)+sqrt(1-x)), x) 

I7 := int( exp(-a*x"2), x) 

I8 := int( x/(log(x))°3, x) 

I9 := int( sin(x)/x°2, x) 

I10:= int( 1/(2+cos(x)), x) 

Di := int( 1/(2+cos(x)), x=0..4#Pi) 

D2 := int( sin(x)/x, x=-infinity..infinity) 

D3 := int( exp(-x)/sqrt(x), x=0..infinity) 

D4 := int( exp(-x)*x°2/(1-exp(-2*x)), x=0..infinity) 
DS := int( exp(-x°2)*log(x)°2, x2#0..infinity) 
D6 := int( exp(-x)*log(x)"2*x°3, x=1..infinity) 
D7 := int( x72/(1+x73), x=0..infinity) 

D8 := int( 1/x°2, x=-1..1) 

D8B:= int( 1/x*2, x=-1..1, continuous) 

D9 := int( exp(-x)*x~(1/3), x=1..infinity) 
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<<OUTPUT>> 


/ 1/2 1/2 1/2 1/2 \ 

| | 
I2 := 1/2 Jarctan( SS ee, ) = Ln (220002 ----- = 2-2 - == === ==) | 2 

| 2 | 

\ (1 + tan(x) ) / 


1/2 


2 
13 1/3 In(x-1) - 1/6 In(x +x +1) +1/3 3 arctan(1/3 (2x+1)3 ) 


I4 := - x cot(x) + ln(sin(x)) 
IS := 
1/2 1/2 1/2 1/2 
2 (x+1) In(x) - 4 (x+1) - 2 1n((x+1) - 1) + 2 In((x+1) + 1) 


3/2 3/2 
16 := 1/3 (x + 1) - 1/3 (x - 1) I 


1/2 1/2 
I10 := 2/3 3 arctan(1/3 tan(1/2 x) 3.) 


4 Pi 
I 2 + cos(x) 


infinity 
/ 


D4 := 7/4 Zeta(3) 
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§/2 1/2 2 1/2 1/2 
D5 := 1/16 Pi + 1/8 Pi gamma + 1/2 Pi gamma ln(2) + 1/2 Pi 


D6 := 2 MeijerG(4, 4, 1) 


D7 := infinity 


D8B := -2 
D9 := GAMMA(4/3, 1) 


In the above the following special notation has been used: Ci for the 
cosine integral, Ei for the exponential integral, erf for the error function, 
gamma for Euler’s constant, GAMMA() for the incomplete gamma function, 
infinity for oo, MeijerG for Meijer’s G function, Pi for 7, and Zeta for 
the zeta function ¢(z). 

From the above we observe that MAPLE could not evaluate the follow- 
ing integrals from the test suite: D1 and D2. The result for I10 is correct, 
but only for a limited range. For integral D8, MAPLE recognized that the 
integrand was discontinuous and so did not evaluate it. When told that 
the integrand was continuous (which is incorrect), MAPLE then obtained 
the answer that would be obtained by just following symbolic rules. 


Example 4 

In Mathematica the integration function has the name Integrate. 
The following Mathematica results were obtained by creating an input 
file, running that file, and then storing the output. This output was 
then manipulated so that each input line is followed by the corresponding 
output line. Mathematica for windows, the version run for the test suite, 
is intended to be used interactively in a graphical mode, and the graphical 
display of the results below looks much better than the corresponding 
printed output. 


Ti: Integrate[{ Sin[x], x] 
T1:-Cos [x] 


I2: Integrate[ Sqrt[Tan[x]], x] 
12: Integrate[Sqrt[Tan[x]], x] 


I3: Integrate[ x/(x*3-1) ,x] 


ArcTan[------- ] 2 
Sqrt [3] Log(-1 + x] Log{i+x+x] 
+ 


2 
1n(2) 


29. 
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14: Integrate[ x/Sin[x]°2, x] 
14:-(x Cot[x]) + Log(Sin[x]] 


IS: Integrate[ Log[x]/Sqrt[x+1], x] 
I15:-4 Sqrt[1 + x] + 4 ArcTanh[Sqrt[1 + x}] + 


2 Sqrt [1 + x] Log(x] 
16: Integrate[ ad Sart ite) eae x] 
16:Sqrt[1 - x] EC - ) + ex *) Sqrt(1 + x] 
I7: Integrate[ pele x] 


3 
Sqrt [Pi] Erf[Sqrt[a] x] 


I7: Camm wee aeee woo oeeoeoe 
2 Sqrt [a] 
18: Integrate[ x/(Log{x])°3, x] 
2 
x x 
I8:2 ExpIntegralEi[2 Log[x]] - --------- - ------ 
2 = Log[x) 
2 Log[x] 

19: Integrate[ Sin[x]/x°2, x] 

Sin[x] 
19:CosIntegral[x] - ------ 

x 


110: Integrate[ 1/(2+Cos[x)) ,x] 
x 


4 Pi 


D2: Integrate[ Sin[x]/x, {x,-Infinity,Infinity}] 
D2:Pi 


D3: Integrate[ Exp[{-x]/Sqrt[x], {x,0,Infinity}] 
D3:Sqrt [Pi] 


D4: Integrate[ Exp[-x]*x°2/(1-Exp[-2*x]), {x,0,Infinity}] 
7 Zeta([3] 


D5: Integrate[ Exp[-x°2]*Log[zx]“2, {x,0,Infinity}] 
2 2 


D5: (Sqrt(Pi] (2 EulerGamma + Pi + 8 EulerGamma Log[2] + 


2 
8 Log{2] )) / 16 
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D6: Integrate[ Exp[-x] *Log[x]“2*x°3, {x,1,Infinity}] 
D6: Indeterminate 


D7: Integrate[ x°2/(1+x°3), {x,0,Infinity}] 
D7: Infinity 


D8: Integrate[ 1/x*2, {x,-1,1}] 
D8:-2 


D9: Integrate[ Exp[{-x]*x~(1/3), {x,1,Infinity}] 


4 4 
D9:Gamma[-] - Gamma[-, 0, 1] 
3 3 


In the above the following special notation has been used: CosInte- 
gral for the cosine integral, Erf for the error function erf, ExpIntegralEi 
for the exponential integral E,(z), EulerGamma for Euler’s constant 7, 
Gamma() for the gamma function (a) = f-° t?-1e~* dé and for the gen- 
eralized incomplete gamma function I'(a,b,c) = f, t?-1e~' dt, Pi for 7, 
and Zeta for the zeta function ¢(z). 

From the above we observe that Mathematica could not evaluate the 
following integrals from the test suite: I2 and D6. Additionally, the result 
for 110 is correct, but only for a limited range. Perhaps because of this 
error, the result for integral D1 is incorrect. Finally, Mathematica made 
an error on integral D8 by not identifying the singularity at zs = 0. 


Example 6 

Since REDUCE cannot perform definite integration, that part of the 
test suite was not run in REDUCE. The following is the result of running 
the indefinite integrals in the test suite on a SPARCstation 2. In REDUCE 
the integration function has the name int. In this listing, each input line 
is followed by the corresponding output line. 


i1 := int( sin(x), x); 
Ii := - COS(X) 


i2 


int( sqrt(tan(x)), x); 
I2 :s INT(SQRT(TAN(X)) ,X) 
i3 :> int( x/(x73-1),x); 
I3 :=s 
1 24X + 1 1 2 1 
---*SQRT (3) *ATAN(--------- ) - ---#LOG(X + X + 1) + ---*LOG(X - 1) 
3 SQRT (3) 6 3 
i4 := int( x/sin(x)"2, x); 


-1 X 2 X 
14 := - SIN(X) *COS(X)*X - LOG(TAN(---) + 1) + LOG(TAN(---)) 
2 2 
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i8§ := int( log(x)/sqrt(x+1), x); 
IS := 2*(SQRT(X + 1)*LOG(X) - 2*SQRT(X + 1) - LOG(SQRT(X + 1) - 1) 
+ LOG(SQRT(X + 1) + 1)) 
i6 := int( exp(-a*x"2), x); 
1 
16 := INT(------- »X) 
2 
AeX 
E 
i7 := int( x/(log(x))*3, x); 
x -1 2 1 -2 2 
17 := 2eINT(-------- »X) - LOG(X) *X - ---*LOG(X) *X 
LOG(X) 2 
i8 := int( x/(sqrt(i+x)+sqrt (1-x)),x); 
1 1 
18 := - ---#SQRT( - X + 1)#X + ---#SQRT( - X + 1) 
3 3 
1 1 
+ ---*SQRT(X + 1)#X + ---*SQRT(X + 1) 
3 3 
i9 := int( 1/(2+cos(x)),x); 
x 
TAN(---) 
2 2 
19 := ---*#SQRT(3) *ATAN (---------- ) 
3 SQRT (3) 
i10:= int( sin(x)/x°2, x); 
SIN(X) 
I10 := INT(-------- »X) 
2 
x 


In the above the following special notation has been used: E for the 
base of natural logarithms e. From the above we observe that REDUCE 
could not evaluate the following indefinite integrals from the test suite: 12, 
I7, and I9. 
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Notes 

{1] The version numbers of the computer languages used above were Derive 
2.08, MACSYMA 417.100, MAPLE 5.0, Mathematica 2.1, REDUCE 3.4. 

[2] All of the above computer packages can perform operations on integrals that 
the system cannot simplify. That is, if a system cannot simplify the integrals 
I= f * f(z) dz or J= fe g(x) dz, it will still be able to differentiate J and 
numerically evaluate J. 

[3] In DERIVE, presently, the only definite integrals that can be computed are 
those for which an indefinite integral can be computed. 

[4] Sometimes a symbolic algebra system can determine a specific integral, yet 
it does not do so without coaching because the result is a mess. For example, 
the integral [ dx/(x° + +1) can clearly be integrated (the roots of a cubic 
can be found analytically, then partial fraction decomposition can be used). 
Yet Macsyma will not, unaided, carry out these steps. See Golden [3]. 

[5] Packages that can handle a wider variety of integrals are constantly being 
created. The theory underlying the algorithms is described in the section 
on Liouville theory (see page 77). 

[6] One must be wary when using computer algebra packages, as errors can 
sometimes arise. For example, the integral J = f az* dz is problematic since 
there are two different forms for the answer depending on whether or not k 
is equal to —1. Some systems will return z*+1/(k + 1) without any further 
information; others will ask the user whether or not k is equal to —1; still 
others will look to explicitly declared domains to determine if k could be 
equal to —1. 

If Derive cannot determine if k could be —1, then it returns the ex- 
pression (gre - 1) /(k +1) for the evaluation of I (see Stoutemyer [6}). 
This expression tends to logz as k — —1. Hence, this expression gives the 
correct result for any specific value of k, provided that a limit is used instead 
of simple substitution. 

[7] Most of the commercial computer algebra packages also include a numeric 
integrator. 

[8] Thanks are extended to Jeffrey Golden for running the test suite in Mac- 
syma, Tony Hearn for running the test suite in REDUCE, and Richard 
Pavelle for running the test suite in MAPLE. 
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30. Contour Integration 


Applicable to Contour integrals, or integrals reducible to contour 
integrals. 
Yields 
An exact evaluation in terms of residues. 
Idea 


A definite integral can sometimes be written as a contour integral. 
Cauchy’s residue theorem may then be used to evaluate the contour integral 
in terms of residues. 


Procedure 

Often, a definite integral can be manipulated into a contour integral. 
A contour integral is an integral for which the integration path is a closed | 
contour in the complex plane. Contour integrals can often be evaluated by 
using Cauchy’s residue theorem. One statement of the theorem is 


Theorem: Let f(z) be analytic in a simply connected do- 
main D except for finitely many points {a;} at which f may 
have isolated singularities. Let C be a simple closed contour, 
traversed in the positive sense (see Notes, below), that lies in 
D and does not pass through any point a;. Then 


| f(z)dz= 2ni )- residue of f at a; (30.1) 
c 


where the sum is extended over all the points {a;} that are 
inside the contour C (see Figure 30.1). 


If f(z), when expanded in a Laurent series about the point a, has the 
form 


_ _a-m A—m+1 a—} 
f(z)= = ee ayn aie ror ne g(a) (30.2) 


where g(z) is analytic at a, then the residue of f at the point @ is the 
term a_,. A straightforward way to determine this term, when f has the 
expansion indicated in (30.2), is by 
jogs? 
(n — 1)! dz" 


[(z - a)" f(z)] (30.3) 


z=aQa 


a-, = 
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--- 


Figure 30.1 A contour C that contains a singularity. The singularities are 
indicated by crosses. 


where n > m. For computational ease, though, it is best to take n = m if 
the value of m is known. 

If the contour C passes through a simple pole, then the contour can 
sometimes be deformed around the pole and then the following theorem 
can be used: 


Theorem: Let f(z) have a simple pole at z = a with residue 
a—; and let A = A(e,¢) be an arc of the circle |z — al = € 
that subtends an angle ¢ at the center of the circle. Then 


im, fa f(z) dz =idga-1. 


If we had integrated over the entire circle (i.e., ¢ = 27) then the residue 
theorem states that the answer would be 27ia_,, without any limiting 
process involved. This theorem indicates that integrating over a fraction 
of the circle yields a corresponding fraction of 27ia_,, provided the pole is 
simple (i.e., m = 1 in (30.2)) and the limit ¢ — 0 is taken. 

There are many examples in this section, and each one attempts 
to demonstrate a different method or technique that can be used when 
evaluating contour integrals. 


Example 1 
Consider the integral 
27 
dé 
= ———.. 4 
e | 2+ cos 8 ia 


If we make the change of variable z = e*? then dz = ie’d@ or dO = 
—iz—1 dz. Hence, using cos6 = 3 (e” + e~*) = 3 (z+ 271), we can write 


(30.4) as 
Pics / —iz dz 
J 244 (24274) 


; (30.5) 
z~+4z+1 
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--- 


Cc aust circle.) 


—-“« -------- --> 
WX, =-2tV3=_ 0.68 
Of su 13 =-3.432 


r—_ 


| 
| 
| 
Figure 30.2 Contour of integration for Example 1. The singularities of the 
integrand are indicated by crosses. 


Coun fercl chinice 


Now we must determine what the new range of integration is. As 8 varies 
from 0 to 27, z traces out a circle of radius one in the clockwise sense (see 
Figure 30.2). Hence, we can use the Cauchy residue theorem. If we write 
I as 


2 
I=-i [ Goa\ere)™ (30.6) 


z—a4)(z—a_) 


where C represents the contour in Figure 30.2, and ag = —2+ V3, then 
we see that only a4 is inside of the contour C (the a4 are indicated on 
Figure 30.2). The Laurent series of the integrand about the point a4 is 


= -(—_) nz), (30.7) 


(z —az)(z-—a@_) a,-a_}/ z—-ayz 


2 
(a_ —a4)(z-—a_ 
of the integrand at a4 is equal to 2/(a; —a_). Using this in (30.1) results 
in 


where h(z) = is analytic at z = a;. Hence, the residue 


I = -i x 2m > residues of integrand 
( 2 ) 2 21 (30.8) 
= 2a | ——— _] = 2a -——__—"—~ = —. 
ay — a (-2 + v3) - (-2- v3) v3 
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A A 
| I 
Dr 
I 
' (*™ 
Se —— eee eee eS =e 
-R "Cp R -R CR R 


Figure 30.3 (a) Integration contour for (30.9); (b) integration contour for 
(30.10). 


Example 2 
Consider the integral 


iz 


(os) e'= e 
J= i; —5>—~ dx = lim i 5-—~ dz, (30.9) 
nage oe R-00 Jo, 2° + 1 


where the contour Cr is shown in Figure 30.3.a. To have a closed contour, 
we define the new integral 


x=( +/ \ane (30.10 
Cr Dr 2741 ) 


where the contour Dar is shown in Figure 30.3.b. The only isolated singu- 
larity inside of the combined contour Cr U Dp is at z = i, and the residue 
at this pole is e~!/2i. This residue is found by using (30.3) with n = 1: 


Lc . e : ei en! 
a1 = 9 lim (@-05) = lim (=) ie rae (30.11) 
e* Oe geltit + i(z +3) 
T 8 Se ee h h = —_——_ i 
hat is, ad 24 ( a) + h(z) where h(z) mara D is 


analytic at z = i. Therefore, using the residue theorem, we have K = 
2m (e~ 1/21) = we7}. 

Now, how does K (what we have calculated) relate to J (what we want 
to find)? Observe that 


e 
[frets] 
Dpz +1 Dr 


tz 


i| 


z+ 


(30.12) 
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Figure 30.4 Integration contour for (30.14). 


where we have used Jordan’s lemma (see Notes, below). Hence, as R — oo, 
the integral Sop vanishes and we have 


J= lim = lim (x- aKa, (30.13) 
Dr 


R00 Ca R—- 00 


where the integrand is not displayed when it is understood to be the same 
as in (30.9). Using (30.9) in (30.13), and taking the real and imaginary 
parts, results in the two integrals 


© sins °° coszx 
/ 5—~ dx = 0, i 5—~ dx = me™. 
aef- Fl -o 2 +1 


The first of these two integrals could have been obtained immediately by 
symmetry considerations. 


Example 3 
Consider the integral J = / 


—0o 
then J = ImJ. Now consider the following contour integral aS Fig- 


ure 30.4): 
= lim [ +f +f — ade. (30.14) 
ETS (ele, R) 2 ICR 


e—cao 


oo Pd 


fo) e 
au dz. If we define J = Es aa 


Here, Cr is a semicircular arc of radius R, C, is asemicircular arc of radius €, 
and C(e, R) is the union of two intervals: C = [—R, —e]U[e, R]. Since there 
are no singularities of the integrand within the contour C(c, R) UC, UCR, 
we find that K = 0. 

Now we will determine each of the integrals in (30.14). We immediately 

tz 
recognize that J = jim — dz. By Jordan’s lemma, it is easy to see 
pape C(e,R) 
that limp_.oo Jon = 0. The integral lim J. (e#/z) dz can be evaluated 
é— € 
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Figure 30.5 Contour used in (30.15). The thick line represents the branch cut, 
and the crosses indicate the location of the poles. 


by using the second theorem in the introductory remarks. We note that 

the angle is ¢ = —7 (the angle is negative since it is being traversed in 

the negative direction) and that there is a simple pole at z = 0 with 

residue a_; = 1. Hence, lim Jc. (7 /z) dz = i(—m)(1) = —ix. Combining 
e— € 

everything we have, we find 


J = lim = K-— lim @ + |) =0-(0-in) = in 
R—- oo C(e,R) R—- oo Cr 


e—0O e—0 


where the integrand is not displayed when it is understood to be the same 
as in (30.14). Taking the imaginary parts of this expression, we determine 
that J=ImJ =r. 


Example 4 
oo 
Consider the integral I = / =, We first consider, instead, the 
0 «6 
integral 
K= [| 2B ae, (30.15) 
cz +l 


and will then determine J from K. For K the integration contour is given 
by C = CRUC, UCug U Cig, where “ud” and “ld” stand for the upper 
diagonal branch and lower diagonal branch, respectively, in Figure 30.5. 
Since K involves a logarithm, a branch cut in the complex plane is needed; 
Figure 30.5 shows the location of the branch cut. With this branch cut we 
have log z = log |z| + 7argz where 0 < argz < 2r. 


30. Contour Integration 135 


The only poles in C are at the the cube roots of —1, {21, z2, 23}, and 
it is easy to derive that 


3 
irae dz = 271 3 residue at z; 
aot (30.16) 


A4n?iV3 
Ef he hel 
9 Cr € Cua Cia 


where the integrand is not displayed when it is understood to be the same 


as in (30.15). 
In the limits R — oo and e — 0 the integrals along the two circular 


arcs vanish, observe: 


e i = 0 (787) 0(n) = 0 a8 R- 0 
Cr R 


log z 


3 
e fo. = O(loge)O(e) + 0 ase > 0. 
Taking the limits R — oo and e — 0 in (30.16) results in 


2: 
ya LL LL) 
9 aay Cr € Cua Cia 


= anf +f} 
Axe Weu Je 
os ib 0 log ( re*(?—-9) 
i log (re ) 18 dp 4 | 6 et(27—8) dr 
o 1+ (rei6)” oy 4 (rett2-0)" 


If we now take the limit 6 — 0 in this last integral, we obtain 
2. co |] i) 0 log (re*(@"—9) 

208 ye Haan ft em) 
9 6-0 |Jo 1+ (re*®) O14 (rei(?*-2)) 


Al . Qni 
/ oer ras a ad ae 
o l+r co 1+r 


et(27—8) dr 


0 4 
= / oy dr = —2nil. 
1l+r 


From this we conclude that I = 27/3V/3. 
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Figure 30.6 Contour used in (30.17). The thick line represents the branch cut, 
and the cross indicates the location of the pole. 


Example 5 
1 
dz 
Consider the integral J = / ——_=——.. We first consider the 
~1(az +b)V1 — 2? 
integral 
K= i Ge (30.17) 
(az+b)Vz2-1 


and will determine J from K. In K, the contour C is given by C = CRUC,U 
Ce, UC_,UC,, UC UC, where the different components should be clear 
from Figure 30.6. (Note that C_ is along the bottom of the cut, and has 
two components.) Since K involves a square root, branch cuts are present 
and we must define how the square root is to be evaluated. 

We define the function (z? — 1)1/? to be real and positive for Rez > 1, 
and we take z+1 = r,e" and z—1 = roe? with 0 < 0; < 2m; see 
Figure 30.7. With these definitions, along the real axis between —1 and 1 
we have (z? —1)!/2 = V1 — zei(9:+6)/2, On the top of the cut (ie., along 
C_,) 6, = 0 and 62 = 7; on the bottom of the cut (i.e., along C_) 0, = 27 
and 02 = =. 

The only pole in C is at z = —b/a, so that 


K= [ ca = ni (residue at z= -*) seers, 
c (az+b)V2z?-1 a Vb? — a? 
(30.18) 
In the limits R — oo and ¢; — 0 the integrals along the bounding box and 
the two circular arcs vanish. Observe: 
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Figure 30.7 How the square root function is defined in (30.17). 


[= (Fe) OCR) 0 as R00; 
+ [ =0 (Fe) oo 0m ~0 


If we allow the two vertical contours to come together, then the integrals 
along C; and C; cancel, since the integrand is continuous between these 
contours and the contours are going in opposite directions. We presume 
that this limit has been taken, so that C— is now continuous along the 
bottom of the cut. 

Taking the R — oo and ¢; — 0 limits in (30.17), using (30.18), and 
disregarding the C; and C, integrals results in 


__ 2at 


Ve Ve — a? =m { *h. | Ges eaT 
1 
=| way Ita — z2e*/? +f wip ar 3ni/2 
: dx ee 
= (fi geryaias) = 


We conclude that J = 7/V/b? — a?. 


Example 6 

The Laplace transform of the function f(¢) is the function F(s) = 
Lif (é)] = ie e ** f(t) dt. As a rule, F(s) will converge for some region in 
the complex s-plane, typically Res > a, where a is some real constant. 
The inverse Laplace transform is given by 


f(t) = £>'(F(o)] = = i e! F(s) ds, 


where the contour of integration is the vertical line z = o + ity (with —oo < 
y < oo), and o is “to the right” of any singularities of F(t). Often, the 
contour in this integral can be made into a closed contour by closing the 
contour to the left; this results in the Bromwich contour, C UCr, shown in 
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is 
o +100 
Cr C 
-- ---—> 
ao — 100 


I 
Figure 30.8 Bromwich contour used in inverse Laplace transforms. 


Figure 30.8. With a closed contour, of course, Cauchy’s theorem can be 
used. 

Consider the inverse Laplace transform of the function F(s) = 1/(s? + 
4). This function has singularities at s = +2i, so we must take o > 0. 
Defining a new integral with the Bromwich contour 


mo (+) fre 


we note that the only poles are at s = +27. Therefore, the residue theorem 
yields 


1 
K(t) = 2ni | (residue at s = 27) + (residue at s = -2i)| = 5 sin 2t. 


The difference between f(t) (what we want) and K(t) (what we have 
calculated) is the integral [,.. As we now show, this integral vanishes 
as R — oo. 

Let x = Res along Cr. Then, for positive t, we have |e’*| < e’* < e!” 
along Cr. Hence, 


et? e’? 
[ Hye 0(G)ow-0 as R- oO, 


since o is fixed. We obtain the final result f(t) = 3 sin 2¢. 
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Notes 
[1] Jordan’s lemma states: If Cr is the contour z = Re’, 0 < 6 < 7x, then 
fz~te*| |dz| < w (see Levinson and Redheffer [7]). This is often useful for 
estimating integrals. 
[2] The integral in Example 1 had the form J = a f(cos 6, sin 0) d0. Integrals 
of this form can be recast as contour integrals by setting z = e*®. As @ varies 
from 0 to 27, z traverses a unit circle C counterclockwise. Hence, 


z7+1 z27-1\ dz 
r= [s(F , =) S. 


[3] Loop integrals are contour integrals in which the path of integration is 
given by a closed loop. For example, Hankel’s representation of the Gamma 
function when Rez > 0 is given by 


I(r) = ~sramag [CO eta 


2isin7xr c 


where the contour C lies in the complex plane cut along the positive real axis, 
starting at oo, going around the origin once counterclockwise, and ending 
at oo again. 

[4] In the above theorems, the contours were sometimes described as being 
“traversed in the positive sense.” Consider a closed region surrounding the 
contour C(t). Consider the vector giving the direction of increasing t; if a 
counterclockwise rotation of 7/2 causes the vector to point into the interior 
of the closed region, then the contour C is being traversed in the positive 
sense and the region is positively oriented. 

[5] Plaisted [9] shows that the following problem involving the evaluation of a 
contour integral is NP-hard: 


Given integers b and N and a set of k sparse polynomials 
with integer coefficients {p;(z)}, it is NP-hard to determine 
whether the following contour integral is zero: 


pe a 1 i ss 
RN z—b 
where C is any contour cw the origin in its interior. 


See also Garey and Johnson {5}. 
[6] Gluchoff [6] presents the following interpretation of a contour integral: 


f f(2)dz = L(C) av [f(2)(2)] (30.19) 
] 


where L(C) is the length of C, T(z) is the unit tangent to C at z, and “av” 
denotes the averaging function. 

For example, for the integral J = Sim np z/z we identify L(C) = 27R 
and T(z) =iz/R so that (30.19) becomes 


/ dz =27R av E 3 = 2ni av [1] = 2zi. 
jzj=R 7 =r Lz R bee 
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[7] Several of the references describe quadrature rules for numerically approxi- 
mating a contour integral. 

(8) The numerical integrator in the language Mathematica allows an arbitrary 
path in the complex place to be specified. For example, consider the integral 
in (30.5). The integration contour may be deformed to the square with 
vertices at {+1,+i} without changing the value of the integral. If Mathe- 
matica is input “NIntegrate[-2I/(z°2+4z+1) ,z,1,1,-1,-I,1]”, then 
the result is 3.6276 + 0. I, which is the correct numerical value. (Here 
I is used to represent i.) 

[9] The theory of multidimensional residues is based on the general Stokes 
formula and its corollary, the Cauchy—Poincaré integral theorem. Serious 
topological difficulties arise for analytic functions of several complex vari- 
ables because the role of the singular point is now played by surfaces in C”. 
These surfaces generally have a complicated structure requiring tools such 
as algebraic topology. 
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31. Convolution Techniques 


Applicable to Some one dimensional integrals that contain a product 
of terms. 


Yields 
An exact evaluation in terms of other integrals. 
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Idea 
If the original integral can be written as a convolution, then the value 
of the integral may be determined by a sequence of integrals. 


Procedure 

Given the functions f(z) and g(z), and an integral operator J[], define 
the functions F(¢) = I[f(x)] and G(¢) = J[g(x)]. For many common 
integral operators there is a relation that relates an integral of f and g, of 
a specific form, to an integral involving F' and G. These relations are often 
of the form 


ALPEN = f IF a(x,¢))),9°6(2,6)),61M6) a6 (31.1) 


where A[] is an integral operator. Such a relation is known as a convolution 
theorem. 

Convolution theorems may sometimes be used to simplify integrals. 
Given an integral in the form of the right-hand side of (31.1), it may be 
easier to evaluate the left-hand side of (31.1). In the following examples, 
upper case letters denote transforms of lower case letters. 


Example 1 
For the Mellin transform, defined by 


F(s) = MIf(2)] = [ ” f(t) dt, 


the convolution theorem is 


roo) z du 1 ct+ico 
= —_— = — F -8 
I f (7) gu) uo 2at [. (s)G(s)a™ ds 
where the integral on the right-hand side is a Bromwich integral. 


Example 2 
For the Laplace transform pair, defined by 


F(s) = cio) = [ ” e-t9 (4) dt, 
cttoo 
f(t) = L-4F(s)) = a e* F(s) ds, 


c—t00 


the convolution theorem is 


t 
[ f(r)g(t — 7) dr = £7 [F(s)G(s)]. 
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Example 3 
For the Fourier transform pair, defined by 


F(t) = Flo) = = [es (e) de, 
f(a) = FP] = Ge [et F at, 
the convolution theorem is 


“ig / ” f(a)g(w — €) dé = F-[F(t)G(t)). 


Notes 
[1] _Bouwkamp [2] uses the convolution theorem for Fourier transforms to show 
that 
2x oo -ar | 
i) ip op ee 2 aba (fap (eap)| 
0 Jo VWr2?4+D?—-2rDcosd &% 
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32. Differentiation and Integration 


Applicable to Definite and indefinite integrals. 


Yields 
An alternative representation of the integral. 


Idea 

By differentiating or integrating an integral with respect to a param- 
eter, the integral may be more tractable. This parameter may have to be 
introduced into the original integral. 
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Procedure 

Given an integral, try to differentiate or integrate that integral with 
respect to a parameter appearing in the integral. If there are no parameters 
appearing in the integral, insert one and then perform the differentiation 
or integration. 

After the integration is performed then either an integration or a 
differentiation remains. 
Example 1 

Given the integral u(x) = i e~*’ coszt dt, differentiation shows that 
u(x) satisfies the differential equation u’ + SEU = 0. (This was obtained 
by integration by parts.) This differential equation is separable (see Zwill- 
inger [3]) and the solution is found to be u(x) = Ce-*’/4, for some con- 
stant C. From the defining integral, u(0) = {5° e-* dt = 3/7, so we have 


the final answer is 


e—’ cost dt = 1 Vre?/4, (32.1) 
0 
Example 2 
Given the integral 


[eo @] 
I(p) -| zsin(x)e~P* dx 
0 
we might introduce a parameter a and consider instead 
co 
J(a,p) =| x sin(ax)e~?*" dz. (32.2) 
0 


Note that I(p) = J(1,p). Both sides of (32.2) may be integrated with 
respect to a to determine 


f J(a,p) da = [ i x sin(ax)e7 pt” dada 
=-— i’ cos(az)e— Pe? dey, 
0 


This last integral may be evaluated by a simple change of variable and 
using (32.1). The result is 


= 1 [a _.2 
= —,/—e-9'/4P 
i J(a,p) da 2V 5° (32.4) 


Differentiating (32.4) with respect to a results in 


a NT _,2 
5A amar a"/4p 
1 [xr _ 
I(p) = J(l,p) = - Gye. 
Pp 


(32.3.a-b) 


and so 
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Example 3 
Given the integral 


fo @) e 
K(b,q) = [ sin() -- 00 dz (32.5) 


we differentiate with respect to b to obtain K (b,q) = Ss cos(br)e~%" , 
which is the same as (32.3.b). Therefore 


d _1 [®,-0/4q 
= K(b,q) = sys e7 8/49, (32.6) 


From (32.5) we note that K(0,q) = 0. Hence, we need to solve the 
differential equation in (32.6) with this initial condition. The solution is 


b 
1 T 2 
K(b, =| (5 —e~? is) db 
(6, q@) j aq 


6/24 
=r aon = ie (32.7.0-c) 
0 


where we have recognized ee as ae an error function (see page 172). 


Notes 
[1] As another example of the technique illustrated in Example 3, consider the 


integral 
F(y) = [ log(1 + 2 y") dz. (32.8) 
0 1+ 


Differentiating with respect to y produces 


0 


l+ay1+2° 
oo 
_ _2y_ Pad — dx (32.9) 
yl 1+2z 1l+z2°y 
pe 
lity 


if y > 0. From (32.8) we recognize that F(0) = 0. Therefore, we can 
integrate (32.9) to determine 


F(y) = [; Tay Y= Toll +9). 


[2] Squire (2] starts with the identity ii z*-1 dt = t7', and integrates with 
respect to ¢ (from ¢ = 1 to t = a) to obtain 


1 ai 
[ = : dz = log a. 
o  logz 
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[3] Many other clever manipulations based on integration and differentiation 
can be conceived. For example (again from Squire [2]), the identity z~} = 


Jo e~7* dt can be used in the following way: 


[ mt ae- [ sins fe 
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33. Dilogarithms 


Applicable to _ Integrals of a special form. 


Yields 
An exact solution in terms of dilogarithms. 


Idea 

Integrals of the form {* P(x, /R) log Q(z, VR) dz, where P(, ) and 
Q(, ) are rational functions and R = A? + Br + Cz’, can be transformed 
to a canonical form. 


Procedure 
Given the integral 


i= f P(x, VR) log Q(x, VR) dz, (33.1) 


make the change of variable /R = A+ ct. This transformation results in 


_ VA? + Br+Cr?-A 
z= 


_ 2At—B 
— C-# 
dz = 7G ra [AC — Bt + At?] dt 


2 
VR= AC — At 
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so that (33.1) becomes 
t 
I= ij P(t) log Q(t) dt (33.2) 


where P and Q are rational functions of ¢. In principle, partial fraction 
expansion can be used on P to obtain 


P= P()+ 7 Gat ie 


Q = K [[ Ome + t)” 


m,n 


(33.3) 


where P(t) is a polynomial int. Using (33.3) in (33.2), and expanding, leads 
to many integrals. Those integrals that have the form [ P(t) log(y + t) dt 


or the form / ee log(y + t) dt, for n # —1, can be evaluated by 
mn 


integrating by parts. The only integral that cannot be evaluated in this 
manner is 


i log(a + t) Ais log(a — 7) log (244) — Lie (2+) +C, ifa xy, 


t 
Ve 3 log?(y + t) + C, ifa=y7, 
(33.4) 
where Lig() is the dilogarithm function and C is an arbitrary constant. 
The dilogarithm function is defined by 


Lig (x) = — ; : wet = 2) dz. (33.5) 


Hence, the integral in (33.1) can always be integrated analytically 
in terms of the dilogarithm and elementary functions. A few integrals 
involving dilogarithms are shown in Table 33. 


Example 
The integral 


cr+V1+ 2?) dx (33.6) 


es 1 
r= f'n 
zV¥1+<2? 8 


becomes under the change of variable /R = /1 +2? = 1+ zt (which is 
the same as x = 2t/(1 — t?)) 


fs a : flog(1 + ¢) — log(1 — t)] dt, 


= Lig (t) — Lig (-t), (33.7) 


; 1+z?-1 _ fl—-vV1l4+2? 
= Lig —— — Lig | ——————_ } . 


z 
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Table 33. Some integrals involving dilogarithms. 


z nr 
/ log(1 + az”) Fie -1 Li (—a2") 
0 


r 
* log(a + bt), 1 2 (2 )-s 2 (2) 
/ ct+et alles 2e log (ce et) 2e log e 


15 bc — ae 1.. (bc — ae 
. ee (5%) 7 a ( be 
z 2 </ 2 
ee Le dr = 2 Lis ( (vi# -2) ) + 1 hog? Vie 
0 Y1+2? 2 2 2 


z 1 2 ? ; 
fee ae = din (-24) + fi ( 


22 
1+ 2” 


) — Lie (x) 
+ ; log?(1 + z”) — log(1 — x) log(1 + 2”) 
[ wogzlog(s 2) ze dx = Li3(xr) — log rLi2(r) 
0 


1 2 
/ 2° Lis (x) dz = al = Aes 
o 6a 


a 


Notes 

[1] Tables of the dilogarithm may be found in Lewin [2]. 

[2] An extension of the dilogarithm function of one argument is the dilogarithm 
function of two arguments: 


ary fe 2 
Li, (2,0) = _1 log 1 -— 2zrcos6+ 2 dr 
2 
0 z 


where, of course, Lig (z,0) = Liz (xz) for -1 < z < 1. The higher order 
logarithmic functions are defined by Li,(z) = So Lin-1(z)/zdz. All of these 
functions have been well studied; recurrence relations and other formulae 
have been determined for each (see Lewin [2].) 
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34. Elliptic Integrals 


Applicable to Integrals of a special form. 


Yields 
An exact solution in terms of elliptic functions. 


Idea 

Integrals of the form {| R(x, \/T(x)) dx where R(, ) is a rational func- 
tion of its arguments and T(z) is a third of fourth order polynomial can be 
transformed to a canonical form. 


Procedure 
Given an integral of the form 


| R(x, /T(z)) dz (34.1) 


where 


fi(x) + fo(z)VT 
fa(z) + fa(z)VT’ 


T = agx* + a323 + aor? +012 +49, and each f;(x) represents a polynomial 
in z, rewrite the integrand as 


R(x, VF) = ful) + faleVT | fale) ~ fala)VT] | VT 
fa(x) + fa(z)VT | fa) — fa(z)VT | |VT 
_ f(a) + fola)VT (34.2) 
fr(a)VT 
Ro(zx) 
= Ry(xz) + ; 
1( ) VT 
where R(x) and Re(xz) are rational functions of z. Clearly, the integral 
J Ri(xz) dz can be evaluated in terms of logarithms and arc-tangents (see 
page 183). 
We can always write T in the form (see Whittaker and Watson [(10]) 
T = [Ai(x — a)? + By (x — 8)?] [Ao(z — a)? + Bo(x — B)?]. Then, chang- 
ing variables by ¢ = (x — a)/(z — @) results in 


de ra — @)~' dt 
VT VS | 
where S := ,/(A,¢? + B,) (Agt? + Bo). Hence, we find 


Re(2) , _ f Ra(t) 
[ape | is 


R(x, VT) = 


VT 
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where R3 is a rational function. We can now write R3(t) = R4(t?) + 
tRs5(t?), where R4 and Rs are also rational functions (by, say, R4(t?) = 
(R3(t) + R3(—t))/2 and R;(t?) = (R3(t) — R3(—t))/2t). Clearly, the in- 
tegral f tR4(t?)/VS dt can be evaluated in terms of logarithms and arc- 
tangents by introducing the variable z = t? (see page 183). By a partial 
fraction decomposition, we can write 


me 


= 2 a a X Bi, aaa (34.3) 


for some constants {a,}, {(;,,}, and {nj}. By integrations by parts, it turns 
out that we only need to be able to evaluate integrals of three canonical 
forms to determine (34.3) completely. Thus, knowledge of these canonical 
forms allow us to determine (34.1) completely. These three canonical forms 
are, in Legendre’s notation: 


e Elliptic integrals of the first kind (Iyanaga and Kawada [8], page 1452): 


d0 rae dt 
ron | pare h yacaacee 


e Elliptic integrals of the second kind (Iyanaga and Kawada [8], page 
1452): 


$ sin ¢ _, 242 
£(6,k) = [ Vi= sin? 600 = | e 3 dt. (34.5) 
0 0 ~ 


e Elliptic integrals of the third kind (Iyanaga and Kawada [8], page 
1452): 


dé 


¢ 
1(4,n, &) = [ Or 
0 (1+nsin? 6) V1 —k?sin?@ 


(34.6) 


sin d 
~ I (1 + nt?) (1 — #2)(1 — k?8?) 
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Other Manipulations 
There are many ways in which to manipulate an integral to obtain 


an elliptic integral of the first, second, or third kinds. For example, by a 
partial fraction decomposition of (34.2), we can write 


a 
me Aa pt Le a VT’ 


for some constants {A,}, {B;,,}, and {C;}. By writing 


T = ayz* + agz® + agz® +a,2 + ao 


= b4(x — c)* + b3(x — c)* + bo(x — c)? + bi (az — c) + bo, S40) 


we see that we only need to be able to evaluate integrals of the form 


Oe ee a 
r= | ae and i= | Gay VT (34.8) 


in order to evaluate (34.1). The recurrence relations 


(s + 2)agI543 + $03(28 + 3)I542 + @2(s + 1)Io41 + $01(28 + 1)J, 
+ sdglp-1 = 2°VT for s = 0,1,2,... 
(2 _ 8)b4J5-3 + 763(3 - 28) Js—2 + be(1 - 8)Je-1 + 4b3(1 —- 2s8)J, 
— sboJs41 = (x —- c)PVT for s = 1,2,3,... 
(34.9) 
allow some manipulation of the {J,} and the {Jy}. 


There are several different methods for calculating Ip, depending on 
the exact form of T(z). For example, if T(z) = Qi(x)Qo(x), where 


Qi(x) = ax? + br +c, 
Qo(x) = dz? + ex + f, 


then the change of variable z = ./Q(x)/Qoe(z) allows Ip to be written as 


(34.10) 


oo 
V Q1(r)Q2(z) 


+/ (e? — 4df)z4 + 2(2af + 2cd — be)z? + (b? — 4ac) 
(34.11.a-b) 
Note that the radical in (34.11.b) is the discriminant of Qoz? — Q, (i.e., 
what would appear in the radical if the quadratic formula were used to 
solve Qoz? — Q,; = 0 for the variable =). 
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Example 1 
Suppose we have the integral 


ead — 
oy «(322 + 22+ 1) 


Since this has the form of (34.10), with Qi(z) = x and Qo(z) = 327+2z2+1 
we make the change of variable 


= fQi(z) _ / r 
oe Qo(z) Y 327 4+224+1 


This leads to (using (34.11)) J = + f 2//1 — 4? — 8t4 dt. Defining 6? = 
(1+ V3)/4 and —a? = (1—/3)/4, we observe that J can be written in the 
form 


1 ft dt 


This standard form can be found in Abramowitz and Stegun [1], 17.4.49. If 
the lower limit on the integral in (34.12) is taken to be b, then the integral 
is equal to 


1 1 a 

I = 4+—-_——F | sin™' t, ——=—= 
V2 Va? + 0? ( =) 
1 1 _ft| @ 

= +————— nc | -|5=—5 }, 
V2 Ja? +B? bla*+b 


where nc is a Jacobian elliptic function (see Table 34). 


Example 2 
Given the integral 


re / : : 
1 V(5a? — 4x — 1) (122? — 42 - 1)’ 
we change variables by y = 1/z to obtain 


l/z —dy 


ee, 
1 -¥ (5 — 4y — y?) (12 — 4y — y?) 
The change of variable ¢ = 3(y + 2) results in 
ae dt 
1 (1 — ¢?) (1 -— S#?) 


--§[P(23)-r(03)) 


152 III Exact Analytical Methods 


Example 3 
Given the integral 


5 dx 
aes I J (22 — 22) (322 +4) 


we change variables by ¢ = (2 — 3x)/(6 + 3z) to obtain 


3 dt 
V6 maT 


Introducing v? = 1 — 9?, we find 


1 f du 
DD pt et 
al \/(a — v2) (1 — 402) 


-3(0) 


Table 34. Some relationships between elliptic integrals, elliptic functions in 
Legendre notation, and Jacobian elliptic functions (from Abramowitz and Ste- 
gun [1], page 566). In the following, + = sin ¢. 


If a > b and k? = (a? — b”)/a?, then 
z 
rin-<f tn 


o Ae + 02)(2 +2) 


with ¢ defined by tang = 7 


z) 


with ¢ defined by tan¢ = = 
z= 


eee i dt ae 2 
EOE) = | J (a? — t?)(t? — b2) ne & ) 
2(n? — 52) 


i : a 
with ¢ defined by sin? ¢ = 3 
£ 


: x(a? — 6°)’ 
F(6,8) =a | aay (; k) 


with ¢ defined by sin? ¢ = 


z 


ee eel See 
F(6,k) =a f (t2 + a2)(t2 + b2) ad (= 


2 2 
a--wz 


5: 
a’ —b 
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If a > b and k? = b?/a?, then 


dt 
F(R) =a [ (a? — #)(b? 22) 


: dt 

sh af Via - P(e — 2) 
> dt 

F(¢,k) = | Veo P oy = 


‘i dt 
F(¢, k) = a Vie — a)? — b) = a2)(t2 7 B) = 


If k? = a?/(a? + b?), then 
F(¢,k) = Va@ +E ; e 


F(¢,k) = V4 i 


If k? = b? /(a? + 67), then 
F(¢,k) = Va? +B / 


b 
F(¢,k) = VaR FE i 


— 


tlh se ( 
o /(t? + a2)(b? — t2) ab 


dt 
2 V(t + a?)(B — #2) 
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-1 (2|  ,2 
I *) 
with ¢ defined by sing = = 
-1 {7} 2 
(5|*) 
2 2 
with ¢ defined by sin? ¢ = a°(b? ~ 2°) =) 
b°(a? — 2”)’ 
*(Gl¥) 
a 
ial pie 
with ¢ defined by sin* ¢ = ar ; 


at (; 
a 


) 


with ¢ defined by sing = =. 


| eco 7 GI) 


with ¢ defined by cos ¢ = 2; 
~-i £ k? 
Va? + b? 
a2 +b? 
with ¢ defined by sin? ¢ = = . 
242° 
ZV a? + b? k? 
2/2 , 22 
. . z(a +b°) 
with ¢ defined by sin? ¢ = Ba? +27)’ 


—on-) (=| 2,2 
pe (=|) 


with ¢ defined by cos ¢ = :- 
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Notes 

[1] For the elliptic integrals in Legendre’s notation, k is called the parameter 
or modulus, k' = /1 — k? is called the complementary modulus, ¢ is called 
the amplitude, and for k = sina we define a@ to be the modular angle. In 
other representations of the elliptic functions, the variables m = k? and 
m, =1—m=k’? =1-k? are sometimes used. 

[2] The elliptic integrals of the first and second kind are said to be complete 
when the amplitude is ¢ = 7/2, and so z = 1. The following special notation 
is then used: 


K = K(k) = F(Z,k) =|" 


1 — k? 1 — k? sin? 8 rf) 


E = E(k) = E(5,k) =[ 1 — k? sin? 6 d0. 


The complementary values are defined by K' = K'(k) = K(k’) = K(V1 — k?) 
and E’ = E’(k) = E(k’) = E(/1—k?). These values are related by 
Legendre’s relation: EK' + E'K — KK' = 7/2. 

[3] The 9 Jacobian elliptic functions, {cd, cs, dc, ds, nc, nd, ns, sc, sd}, can be 
defined in terms of the three “basic” Jacobian elliptic functions: sn, cn, and 
dn. We have the standard relationships (from Abramowitz and Stegun [1], 
16.3) 


nu dnu 

cdu = —, dcu = —-, nsu = —., 
cnu snu 

snu dnu 
sdu = —-, ncu = —, 6=—, 
u cnu sn u 

1 sn u cn u 

ndu = —, scu = —-, u=— 
dn wu chu nu 


The “basic” functions may be calculated from 


snu = sn(ulk’) = sing 
cnu = cn(ulk”) = cos¢ = V1 —sn?u (34.13) 
dnu = dn(ulk?) = 1 — k? sn? u 


where u is determined by an elliptic function of the first kind: u = F(¢, k). 
(That is, sn is the inverse function to F. Observe: sn(F(¢, k)|k) = sin ¢.) 
Tables of the Jacobian elliptic functions may be found in Abramowitz and 
Stegun [1]. A superscript of —1 on any one of these twelve functions denotes 
the inverse function. 

Table 34 relates the Legendre elliptic functions to the Jacobian elliptic 
functions. 


34. 


[4] 


[5] 


[6] 


[7] 
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The differential equation (y’)? = 1 — y? with y(0) = 0 has the solution 
y(x) = sin(x), with a period of 


1 dt 1 dz 
P=2)o —a.=4/ —,=27. 
ls [ V1—x2? : 


Analogously, the differential equation (y’)? = (1—y”)(1—k?y”) with y(0) = 0 
has the solution y(z) = sn(x) = sn(z|k?), with a period of 


1 
-4/ ——_#____ = 
sie af (1 — 22)(1 — kx?) 


The Jacobian elliptic function sn(u) satisfies (see (34.13)) 


2 ed 2 
sn(u) = sn(u|k”) = sn [ ————_——— | k* ] = sin¢g. 
0 V1—k?sin? 6 


Under the transformation t = sin@ and z = sin ¢ this becomes (see (34.4)) 


= dt 2\ _ 
sn ¢ Jao PR) Gd LER) k = 2: 


Since sn(z|0) = sin z, the limit of k — 0 produces 


sin [ e =f or sin (sin~* 2) =7. 
o V1-?#? 


Technically, any doubly periodic meromorphic function is called an elliptic 
function. All of the usual elliptic functions are doubly periodic; for example, 
snz = sn(xz + 2iK’) = sn(z + 4K). 

Carlson (4]-[7] has introduced a new notation for the elliptic functions that 
preserves certain symmetries. Define four functions: 


yy eee. es 

Rr(2,y,z) = if (¢+x)(t+y)(t+z) 
2) (fee eee 
Ra(z,y, 2,w) = 4] (t+2)(t+y)(t+z)(t+w) 


Re(z,y) = Rr(z,y,y) 
Ro(z, y; z) = Ry(z,y, z, z). 


Each function has the value unity when all of its arguments are unity, and Rc 
and Ry are interpreted as Cauchy principal values when the last argument 
is negative. These functions may be calculated by the numerical routines 
presented in Carlson ([5]-(6). 
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The relationship between Legendre’s notation and Carlson’s notation 
is as follows: 


= 1 fF jz—2) 
Reteiyee) = 7 (cos 2’ z—y 


F(¢,k) = sin¢Rr(cos? ¢, 1 — k? sin? ¢, 1) 
E(¢,) = sin @Rr(cos” ¢, 1 — k* sin” ¢, 1) 
~ 4k? sin® $Rp(cos” ¢, 1 — k? sin? ¢, 1) 
II(¢,n, k) = sin dRr(cos” ¢, 1 ~ k? sin? ¢, 1) 
+ insin® ¢R3(cos’ $,1 — k’ sin” ¢,1,1 — nsin” ¢) 
From the above we find E(k) = Rr(0,1 — k?,1) — 3k? Rp(0,1 — k?, 1) and 
K(k) = Rr(0,1 — k?,1). Use of Carlson’s notation for elliptical integrals 
dramatically reduces the number of separate cases that need to be tabulated 


in integral tables. 
[8] The Weierstrass P function is an elliptic function defined by 


P(u) = P(u;o1,w2) = a > ( 1 : } 


u (u-ay 


n=...,—1,0,1,... 

=...,- 1,0,1,... 

NS=2mw,+2nwg 

where the prime means that the term n = m = 0 is not present in the sum. 
The function z = P(u) is the inverse function of the elliptic integral (see 


Iyanaga and Kawada [8], page 483) 


“= / oo ee, (34.14) 
-oo 1/423 — goz — 93 


[9] Weierstrass showed that any elliptic integral could be transformed into terms 
of the form of (34.14) by a linear fractional transformation. 

It is not hard to see that an integral of the form I = [ Ri(x, /¢(2)) dz, 

where R; is a rational function and ¢(x) is a quartic polynomial, can be 

ay + B 

vy + 6 


(with Is # 0), J takes the form I = f Ro(y, \/#(y)) dy, where Re is 


a rational function and (y) is a quartic polynomial. By an appropriate 
choice of coefficients in the transformation, 7 can have the form #(y) = 
4y® — goy — gs. 

To understand this transformation, let c be a root of ¢(z), and presume 
that ¢(z) does not have multiple roots. Then the transformation rz = c+1/z 
results in 


mapped to the form of (34.14). With a bilinear transformation, z = 


¢'(c)2z + 3o'"(c)2? +... 
o(z) = ———_+—_ _. 
That is, it yields a new elliptic integral that only involves a cubic polynomial. 
If we further let z = ay + 6, then, for a suitable choice of b the coefficient of 
y’ in the cubic polynomial will vanish. Finally, by choice of a we can force 
the coefficient of y* to be 4. For more details, see Akhiezer [2], pages 15-16. 


35. 


[10] 


[11] 


[12 
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Integrals of the form J = f R(a, \/=(x)) dz, where R is a rational function 
and © is polynomial of degree n > 4 are called hyperelliptic integrals. If 
n = 2p+ 2 (where p is an integer) then, by rational transformations, one 
can obtain an equivalent integral in which the polynomial is of degree 2p +1 
(see the previous note). See Byrd and Friedman [3] for details. 

Consider an ellipse described by the parametric equations z = acos@ and 
y = bsin#@, with b > a > 0. The length of arc from @ = 0 to 6 = ¢ is given 
by s=b i 1 — k? sin? 6 d0, where k? = (b? — a”)/b”. It is because of this 
application that the integrals in this section are called elliptic integrals. 
Since there are many representations of elliptic functions, and many of 
them do not indicate the full functional dependence, symbolic and numerical 
tables of elliptic functions should be used carefully. 
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35. Frullanian Integrals 


Applicable to Integrals of a special form. 
Yields 


An analytic expression for the integral. 
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Idea 

A convergent integral can sometimes be written as the difference of 
two integrals that each diverge. If these two integrals diverge in the same 
way, then the difference may be evaluated by certain limiting processes. 


Procedure 
A special case will illustrate the general procedure. Consider the 
convergent integral 


© sin? x 1 f~ 3sinz — sin3z 
(a eee 
0 Zz 0 zr 


It is improper to write this integral as 


1 f* 3sinz 1 f/~ sin3z 
1=7/ a oe de-7 | * dz, 


since both of these integrals diverge. It is proper, however, to write 


oo : CO: 
t= tm y sae — [ ase de) 
456-0 \Js5 x 5 x 


which can be written as (using y = 3z in the second integral) 


OO _: CO: 
lim ( | sates dz — saad ay) 
6-0 \J5 = 36 Y 


; (35.1) 


Example 
The above procedure can be used to derive the general rule 


[AP te = 11100) - 11082. (852) 
0 Zz 


bad cs 
The integral J = i prbae dz is in the form of (35.2), 


0 £ 
with f(z) = tanhz. Since tanh(oo) = 1 and tanh(0) = 0 we find that 
J = log(a/b). 
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Notes 
{i] A modification of the formula in (35.2) is (see Ostrowski (3]) 


[PP ce = min - mise §, 
6 z b 


1 ; 
where M[f] = lime+eo Jo f(2) dz and m{[f] = limesot f- f(z) dz. 
[2] <A generalization of the formula in (35.2) is 


on 


[ [ue f (us) = of(v)| dz = M{[zf(z)| log — 53) et m(zf(z)| log u(0) 
0 


v(0) 
when u and v are positive absolutely continuous functions and the limits 


involving u/v are positive, and M[xf(x)| and m[zf(z)] exist. 
[3] A different generalization of the formula in (35.2) is 


1s f (ax?) - fbx") 4 
09 


0 
= 7 loga__logb| _ p-q [™ 
= [f(oo) — f(0)] [#82 aN | + ea [ f(x) log x dx. 


This formula can be extended (see Hardy [2]) to 


i [f (az?) — f (b2*)) log" edz 


— N+1)\|log"a  log"”b 
= ag eo (NE1) [Se - SP] [ seentog oh eae 


n=0 v 
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36. Functional Equations 


Applicable to Definite integrals. 


Yields 

Sometimes an integral can be formulated as the solution to a functional 
equation. (That is, an algebraic equation relating the unknown function at 
different values of the dependent variable.) 


Idea 
By manipulating an integral into a functional equation, it may be 
possible to evaluate the integral or to obtain information about the integral. 


Procedure 
There are many types of functional equations that may exist. There 
are no general rules on how best to proceed. 


Example 
Consider the integral 


I(a) = i log (1 + 2acosz +a?) dz. (36.1) 
0 
Breaking up the region of integration, j: = . ae ie ja Shows that I (a) = 
I(—a). Therefore: 


nv 
2I(a) = 7. [log (1 + 2acosx + a”) + log (1 — 2acosz + a7)| dz 
0 
x (36.2) 
= [ log (1 + a* + 2a7(1 — 2cos? x)) dz. 
0 


By performing many manipulations, such as 


wT 3x /4 
/ log (1 + 2acos x + a’) de =2 | log (1 + 2asinz + a”) dz, 
a/2 n/{2 


the last integral in (36.2) can be shown to be equal to 
2I(a) = i log (1 + 2a? sin? x + a*) dx = I(a’). 
Hence, our functional equation is 2J(a) = I(a?). This is equivalent to 
(a) = I (a). (36.3) 
Now note that J(0) = 0. When a? < 1, both terms on the right-hand side 


of (36.3) are approaching zero as n — oo. Therefore, we conclude that 
I(a) = 0 for a? < 1. 
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Notes 
[1] The above example is from Squire [2]. Squire shows that the complete 


2 
mation of (063) goon by Ho) = {9g RERSY. 


[2] In Book [1] the problem was to show that 


ds 
1+s7° 


me (t)y at 1 [{* 
—a(t — 
i {1 -e? } ar =, where q(t) = | log(1 + st) 


The first solution given in Book [1] started from the two functional equations 
for q(t): 


q(t) =4q (=) + ; log t and q(t) + q(—t) = log(1 — it), 


where each functional equation has a different domain of applicability. 
[3] Consider the integral J = iidg * sin? c dx. This integral can be manipulated 
into J = ifs cos? x dz. Adding these two representations of J results in 
{2 


— 7/272 +2 a oe et 
21 = ff," (cos’ «+ sin? z) dx = f) = 5180 that I= 7. 


° jogz 
r= | 8A de. 
0 1+2 


Using the change of variable z = 1/z we obtain 


* log z 
t=-f SF dz = I. 
0 l+z 


[4] Consider the integral 


We conclude that J = 0. 
[5] Consider the integral 


m3 sin” x 
f= —a oor 
o sm £+cos z 
Using z = 1/2 — az we find 
Ee cos” z 
I= a> az 
o sim 2+ cos z 


Adding these two expressions for J results in 2J = iba dy = 1/2. Hence, 
I = 1/4 (independent of n). 
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37. Integration by Parts 


Applicable to Single and multiple integrals. 


Yields 
A reformulation of the integral. 


Idea 
There is a simple integration by parts formula; it enables many inte- 
grals to be evaluated exactly. 


Procedure ‘ 
The single integral J = f° f(x) dx may often be cast into the form 


f= / rere (37.1) 


If this is the case, then (37.1) may be evaluated by the integration by parts 
formula to obtain 
b 


b 
IT=u(z)v(z)| — | u(x)du(z). (37.2) 


a 


Example 1 
If we have the integral 


y 
i= f 2 cos x dx 
0 


we recognize that u = z and v = sinz (since dv = cosrdz). Hence, (37.2) 
may be used to obtain 


y y 
J=axsing -[ sin x dr (37.3) 
0 0 
since du = dz. The last integral appearing in (37.3) is elementary and so 
y y 
J=rsinz| +cosz 


= ysiny + cosy — 1. 
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Example 2 
The Gamma function is defined by the integral T(z) = [5° t?~1e* dt. 
If we choose x = e~' and u = t?/z (so that du = t*—! dt), then this integral 


has the form of (37.1). Hence, from (37.2) we have 


T(z) 


l| 
[_— 
oy 
8 
oo 
N 
y 
ia.) 
| 
~~ 
~~ 
Q, 
~ 


Il 

x1 
ee 
ne 
ra 
= 


or [(z +1) = zI(z). Since we can easily determine that ['(1) = 1, we 
conclude that, when n is a positive integer, !(n+1) = n-(n—1)-...-2-1 = nl. 
Hence, the Gamma function is the generalization of the factorial function. 


Notes 

[1] The integration by parts formula may be re-applied to (37.2). For example, 
if f, stands for the n-th derivative of f and gn stands for the n-th integral 
of g then (see Brown [1}) 


b 
— fige 


b 
+ fogs 
a 


b 
— frg4 
a 


b 
Wie (37.5) 


a 


b 
/ fgdx = fg 


{2} Green’s theorem is essentially a multidimensional generalization of the usual 
integration by parts formula, since it relates the value of an integral to the 
values of some functions on the boundary of the region. See the section on 
line and surface integrals (page 164) for more details. 

[3] Henrici [4] uses Cauchy’s theorem to relate contour integrals to area inte- 
grals. For example, for the region R bounded by the curve [ we have 


7) 
! 
wns ES Of (z) =~ 2 
[ teyae=2 ff a dz dy, | ; : 
R 
tie Ps fin & 


| ="tor 8 + ten 
; Of(z) | 
[sme- 2 ff FO aed 
R 
Y= Cf smn & 


[4] Integration by parts may also be used to obtain an asymptotic expansion of 
an integral, see page 215. 
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38. Line and Surface Integrals 


Applicable to Line and surface integrals. 


Yields 
A reformulation as an ordinary integral. 


Idea 
Using a parameterization, line integrals and surface integrals can be 
written as ordinary integrals. 


Procedure: Line Integrals 

A line integral is an integral whose path of integration is a path in n- 
dimensional space. For example, in two dimensions, if f(z, y) is continuous 
on the curve C, then the integrals f, f(x,y) dx and f, f(x,y) dy both exist. 
Here, C is either continuous, or piece-wise continuous (in which case the 
above integrals are interpreted to be the sum of many integrals, each one 
of which has a smooth contour). 

Line integrals can be evaluated by reducing them to ordinary integrals. 
For example, if f(z, y) is continuous on C, and the integration contour is 
parameterized by (¢(¢), #(¢)) as ¢ varies from a to b, then 


[s. y) dz = [i (ow, ¢'(t) dt, 
[ f(x,y) dy = / 7 (w,¥@) '(t) dt. 


In many applications, line integrals appear in the combination 


r= [ Peewde+ [ ae) dy, 
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which is often abbreviated as 
I= | P(x, y) dz + Q(z, y) dy, (38.1) 
c 


where the parentheses are implicit. 

If the vector u is defined by u = P(x, y)i+ Q(z, y)j, then the integral 
in (38.1) can be represented as J = [, urds, where ds is an element of 
arc-length, and uy = u- T denotes the tangential component of u (that 
is, the component of u in the direction of the unit tangent vector T, the 
sense given by increasing s). Alternately, if the vector v is defined by 
v = Q(z, y)i — P(x, y)j, then the integral in (38.1) can be represented as 
l= 1» vy, ds, where v, = v-n denotes the normal component of v (that 
is, the component of v in the direction of the unit normal vector n which 
is 90° behind T). 


Path Independence 
Let X, Y, Z be continuous in a domain D of space. The line integral 
I= [ Xdx+Y dy + Zdz will be independent of the path in D 


e if and only if u = (X,Y, Z) is a gradient vector: u = grad F, where F 
is defined in D (that is, F, = X, Fy = Y, and F, = Z throughout D), 

e if and only if [, X dx + Y dy + Z dz = 0 on every simple closed curve 
C in D. 


Green’s Theorems 
Green’s theorem, in its simplest form, relates a two-dimensional line 
integral to an integral over an area (see Kaplan [1}): 


Theorem: (Green’s) Let D be a domain of the zy plane and 
let C be a piece-wise smooth simple closed curve in D whose 
interior R is also in D. Let P(r, y) and Q(z, y) be functions 
defined in D and having continuous first partial derivatives 
in D. Then 


frds+ady)= ff ($2 - 5) dz dy. (38.2) 
R 


Green’s theorem can be written in the two alternative forms (using 
u = P(z,y)i + Q(2,y)j and v = Q(z, y)i— P(z,y)j, as above): 


purds= | curl u dz dy 
. R 
prmas= | f div v dz dy. 
c 

R 


The second relation in (38.3) is also known as Stokes’ theorem. This 
theorem is sometimes stated as 


(38.3a-b) 
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Theorem: (Stokes) Let S be a piecewise smooth oriented 
surface in space, whose boundary C is a piecewise simple 
smooth simple closed curve, directed in accordance with the 
given orientation of S. Let u = Li+Mj+Nk bea vector field, 
with continuous and differentiable components, in a domain 
D of space including S. Then, Ji ur ds = f jf (curl u-n) do, 


s 
where n is the chosen unit normal vector on S. That is 


ene) (Se - ) dy dz 
Cc 


OL ON OM OL 
+ (2-28) sas (2H FE) ae dy 


Green’s theorem can be extended to multiply connected domains as 
follows: 


Theorem: Let P(z,y) and Q(z, y) be continuous and have 
continuous derivatives in a domain D of the plane. Let R 
be a closed region in D whose boundary consists of n dis- 
tinct simple closed curves {Ci1,C2,...,Cn}, where C; includes 
{Co,...,Cn} in its interior. Then 


p (Pde + Qayl+ p [Pdr +Qdy]+.. +g [P dz + Q dy] 
Cn 


-{f (2-¥) «0 


2 .9Q OP. 
Specifically, if a5 Oy in D, then 


[P dz + Q dy} + [Pde + Qdy) +...+ f [Pdr + Q dy] = 0. 
Cy C2 Cn 


Procedure: Surface Integrals 
If a surface S is given in the form z = f(z,y) for (x,y) in Rzy, with 
normal vector n, then the surface integral 


[aaa Nea +f J (-1 bat Moe aN N) ded, 


with the + sign when n is the upper normal, and the — sign when n is the 
lower normal. If we define v = Li+ Mj + Nk then we may also write 


a Ldyde+Mdzdz+Ndcdy= | [ v-ndo 
s s 
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Figure 38. The contour C for (38.4). 


where do is an element of surface area. Here, n = +(—fzi — fyj+ 
k)/ fl + f2+ f?, with the + or — sign used according to whether n is 


the upper normal or lower normal. 
The generalization of (38.3.a) to 3 dimensions is known as the diver- 
gence theorem, or as Gauss’ theorem: 


Theorem: (Divergence) Let v = Li+ Mj + Nk be a vector 
field in a domain D of space. Let L, M, and N be continuous 
and have continuous derivatives in D. Let S be a piecewise 
smooth surface in D that forms the complete boundary of a 
bounded closed region R in D. Let n be the outer normal of 
S with respect to R. Then 


// onda = fff divwas dyads 
Ss R 


re Ldydz+Mdzdz+Ndzdy 


s 
OL OM aN 
“If (ee +e) dx dy dz. 
Example 1 


Consider the integral 


that is 


I -[ (x* — y*) dy (38.4) 


where C is the semicircle y = 1 — x? shown in Figure 38. The contour C 
can be represented parametrically by x = cost and y = sint forO <t< 7. 
Hence, the integral can be evaluated as 


I= i (cos* ¢ — sin* ¢) cost dt = =. (38.5) 
0 
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Alternatively, the integral could have been evaluated by using the z- 
parameterization throughout 


I= a (z° -—(1- 2)3/?) (==) dz. 


This integral, which looks more awkward, is equivalent to (38.5) under the 
substitution z = cost. 


Example 2 
Here are a few examples of Green’s theorem: 


(A) Consider the integral K = ¢, [(y? + sinz”) dx + (cosy? — x) dy], where 
C is the boundary of the unit square (R:= {0< 2<1,0<y<1}). A 
direct evaluation of this integral by parameterizing C is quite difficult. 
For example, using z as the parameter on the bottom piece of C, 
{y = 0, 0 < z < 1}, necessitates the evaluation of the integral 
\ sin x” dz, which is not elementary. However, using Green’s theorem 
in (38.2) (with P = y? +sinx? and Q = cos y? — x) we may write this 
integral as K = f f (-—1—2y)dxdy. As a set of iterated integrals, we 

R 


readily find that K = —2. 
(B) Let C be the circle x? + y? = 1. Then, using (38.2) 


§ [4ary? da + 627y? dy] = // (12ry? — 122y”) dr dy = 0. 
c 
R 


(C) Let C be the ellipse x? + 4y? = 4. Then, using (38.2) 


§ [(2a — y) da + (x + 3y) dy] = / (1+1) drdy 
r R 
= 2(area of ellipse) = 47. 


Notes 

[1] When the contour of integration in a line integral is closed, then we often 
represent the integral by the symbol f , rather than the usual f : 

[2] When the contour in a two-dimensional line integral is closed, and the 
integrand is analytic, then contour integration techniques may be used (see 
page 129). Sometimes a two-dimensional line integral can be extended to a 
closed contour and be evaluated in this manner. (Note, however, that the 
integrand in (38.4) is not analytic.) 

(3] The evaluation of the integral in Example 2.C required that an area be 
known. Using Green’s theorems, we can write the following integral expres- 
sions for the area bounded by the contour C: 


area = f rdy=— yar. 
Cc c 
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[4] If D is a three-dimensional domain with boundary B, let dV represent the 
volume element of D, let ds represent the surface element of B, and let 
dS = ndS, where n is the outer normal vector of the surface B. Then 
Gauss’s formulas are (see Iyanaga and Kawada (3], page 1400) 

cede ee 
D 
fae |[[s-- [foxes 
|ffvoe- [Jo 
where ¢ is an arbitrary scalar and A is an arbitrary vector. 

[5] There are also Green’s theorems that relate a volume integral to a surface 
integral. Let V be a volume with surface S, which we assume to be simple 
and closed. Define n to be the outward normal to S. Let ¢ and w be scalar 
functions which, together with V?¢ and V7, are defined in V and on S. 
Then (see Gradshteyn and Ryzhik [2], page 1089) 

(A) Green’s first theorem states that 
oy 2 
3? on dS = | (¢V'¥+V¢- Vy) dV. 
v 
(B) Green’s second theorem states that 
Ow 2) ds = 2 2 
[ee Vn) = | (9V'w- vd) av 
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39. Look Up Technique 


Applicable to Integrals of certain forms. 


Yields 


An exact evaluation, an approximate evaluation, or a numerical tech- 
nique. 


Idea 

Many integrals have been named and well studied. If a given integral 
can be transformed to a known form, then information about the evaluation 
may be obtained from the appropriate reference. 


Procedure 


Compare the integral of interest with the lists on the following pages. 
If the integral of interest appears, see the reference cited for that integral. 


There are four lists of integrals, those with no parameters (i.e., con- 
stants), those with one parameter, those with two parameters, and those 
with three or more parameters. 


Notes 

[1] The integrals in this section cannot be evaluated, in closed form, in terms 
of elementary functions (see page 77). 

[2] Some of the integrals are only defined for some values of the parameters; 
these restrictions are not listed in the tables. For example, the gamma 
function I'(z) is not defined when z is a negative integer. 

[3] Realize that the same integral may look different when written in different 
variables. A transformation of your integral may be required to make it look 
like one of the forms listed. 

[4] In this section, the references follow the listings of integrals. 

[5] If the integral desired is not of a common form, then it will not appear in 
this section. However, it might be tabulated in one of the tables of integrals, 
see page 190. 
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Constants Defined by Integrals 


Catalan’s constant (see Lewin [21], page nee 
: tan™’t 
G = Tio(1) = —_= t= 7 0.91596559. 


Euler’s constant (see Gradshteyn and Ryzhik [15], 8.367.4, page 946) 


co 
y= -| e~* logt dt ~ 0.577215. 
0 


Unnamed - related to random permutations (see Goh and Schmutz [(14)]) 


7 e 
Z= | log log ( = 
0 1- 


) dt =~ 1.11786. 


Integrals with One Parameter 


Airy function (see Spanier and Oldham [26], 56:3:1, page 555) 
Ai(z) = 2 f° cos (5° + zt) dt. 

Related to Airy’s function (see Abramowitz and Stegun [1], 10.4.42, page 448) 
Gi(z) = : [ ts (50 + t) dt. 

Related to Airy’s function (see Abramowitz and Stegun [1], 10.4.44, page 448) 
Hi(z) = if" exp (38 + zt) dt. 

Bairy function (see Abramowitz and Stegun (1), 10.4) 


Lp e os 
Bi(z) = = cos| + azt } exp -5 + xt | dt. 
) 


Binet integrals (see Van Der Laan and Temme [19], page 122) 
tan “(t/z 
s(e)=2 [” tap a 
0 eé 


Bloch-Gruneisen integral (see Deutsch {9]) 


zx ° 
=f @=naaes 


+ ptae 
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Clausen’s integral (see Lewin [21], Chapter 4, pages 91-105) 

Cle(6) = - i ° log (2 sin =) dt. 
Cosine integral (see Abramowitz and Stegun [1], 5.2.2, page 231) 


, * cost —1 
Ci(z) = 7 + logz + — 
0 


Auxiliary cosine integral (see Spanier and Oldham [26], 38:13:2, page 371) 


te 7 
i(a) = dt. 
gi(z) Ps 


Hyperbolic cosine integral (see Abramowitz and Stegun [1], 5.2.4, page 231) 


Chi(z) = 7 + log z + / cosh at 
0 


Dawson’s integral (see Spanier and Oldham [26], Chapter 42, pages 405-410) 


daw(z) = / et -*” dt. 
0 
Dilogarithm (see Lewin (21]) 
P = * logt 
Lie(z) = / t-1 dt. 


Error function (see Abramowitz and Stegun [1], 7.1.1, page 297) 


4 
erf(z) = =| edt. 
0 


Complementary error function (see Abramowitz and Stegun [1], 7.1.2, page 297) 


erfc(z) = al e dt. 


Complete elliptic integral of the first kind (see page 154) 


n/2 
K(k) = / bai Os 
0 1 — k? sin? 6 


Complete elliptic integral of the second kind (see page 154) 


n{2 
E(k) = | 1 — k? sin? 6 dé. 
0 


Exponential integral (see Abramowitz and Stegun [1], 5.1.1, page 228) 
oo | =t 
Ey(z) = <——dt. 


4 
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Exponential integral (see Abramowitz and Stegun [1], 5.1.2, page 228) 


ot 
—zx 


Fresnel integral (see Abramowitz and Stegun [1], 7.3.1, page 300) 


C(z) = y. cos (4:7) dt. 
0 


Fresnel integral (see Abramowitz and Stegun [1], 7.3.2, page 300) 


S(z) = [ sin ($2) dt. 


Gamma function (see Abramowitz and Stegun [1], 6.1.1, page 255) 
oo 
T(z) -/ t?~1e7* dt. 
0 


Product of Gamma functions (see Abramowitz and Stegun [1], 6.1.17, page 256) 
OO 4z~1 
T(z)P(1 —z) = if : 


—— dt. 
-eottl 


Inverse tangent integral (see Lewin [21], Chapter 2, pages 33-60) 


Tie(z) = i pe dt. 


Lebesgue constants (see Wong [27], page 40) 


mwf/2). 
L, = 2 | [sin (2n + 1)t| es 
T Jo sint 


Legendre’s Chi function (see Lewin [21], page 17) 
1 f* 1+t\ dt 
X2(2) = if si: G =i, 7 
Logarithmic integral (see Abramowitz and Stegun [1], 5.1.3, page 228) 
* dt 
li(z) = —. 
(z) 9 logt 


Psi (Digamma) function (see Abramowitz and Stegun [1], 6.3.21, page 259) 


foe) et e** 
z)= — —- —— | dt. 
( ) [ t {= er 
Phi function (normal probability function) (see Abramowitz and Stegun [1], 
26.2.2, page 931) 


of 
(x) = = / en?! ae. 


vis 
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Riemann’s zeta function (see Abramowitz and Stegun [1], 27.1.3, page 998) 
1 dt dt 
n+1)=— = 
nana 5 fre ras 
Sine integral (see Abramowitz and Stegun [1], 5.2.1, page 231) 
Si(z) = [5 pnt de 


Auxiliary sine integral (see Spanier and Oldham {26], 38:13:1, page 370) 
fi(x) = i: ou dt. 
0 


Hyperbolic sine integral (see Abramowitz and Stegun [1], 5.2.3, page 231) 


Zz ie 
Shi(z) = il sine iy 
0 t 


Trilogarithm (see Lewin [21], Chapter 6, pages 136-168) 
Zr: 
Li3(z) = i Lie(?) dt 
0 t 


Integrals with Two Parameters 


a-order Green’s function (see lyanaga and Kawada [16], page 165B) 


1 oo et 2 
Gals) = 5 | aaa oe (- =) dt. 
Anger function (see Abramowitz and Stegun [1], 12.3.1, page 498) 
ss 
J,(z) = = / cos(v6 — zsin @) dé. 
T Jo 
Bessel function (see Abramowitz and Stegun [1], 9.1.22, page 360) 
T . oo 
Jy(z) = al cos(z sin 8 — v@) dé — svt | ee 
™ Jo m Jo 
Bessel function (see Abramowitz and Stegun [1], 9.1.22, page 360) 


n oo 
Y¥,(z) = | sin(z sin 0—v@) w= | {e’* +e" cos(vm) } eo tsehtave ae. 
0 0 


Beta function (see Abramowitz and Stegun [1], 6.2.1, page 258) 
1 
B(z,w) = il t7-1'(1 —t)”"? dt. 
0 
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Bickley function (see Amos [2]) 


' _ J [O° Kin-1(t)dt forn =1,2,... 
Ie) = { Ko(z) forn = 0 


Debye function (see Abramowitz and Stegun [1], 27.1.1, page 998) 
Zziygn 
2(z,n) = | ee 


Dnestrovskii function of index g (see Robinson [25]) 
nee a 


fale) = tia “t+z. 
Elliptic integral of the first kind (see page 147) 


_ sin d dt 
ere [ (1 — #2)(1 — kt) 


Elliptic integral of the second kind (see page 147) 
sin d _ p-232 
E(¢,k) = ‘) eng 
0 1 Ss t 


Repeated integrals of the error function (see Abramowitz and Stegun [1], 7.2.3, 
page 299) 


: 2 . (¢—z)" 2 
nm fe = 
i” erfc(z) ral Pe 
Exponential integral (see Abramowitz and Stegun [1], 5.1.4, page 228) 
oO zt 
E,(z) = | © dt. 
1 t 
Generalized exponential integral (see Chiccoli et al. [7]) 
co zt 
E,(z) = / : =—dt. 
1 t 


Fermi-Dirac integral (see Fullerton and Rinker [11]) 
oO t” 
F.(a@) = —z dt 


Logarithmic Fermi-Dirac integral (see Fullerton and Rinker [11]) 


00 4 at 
Gila) = | tYlog(i+e**) 
0 


1 4 eo 


Generalized Fresnel integral (see Abramowitz and Stegun [1], 6.5.7, page 262) 
C(a2,a) = / t*—) cost dt. 
=z 
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Generalized Fresnel integral (see Abramowitz and Stegun [1], 6.5.8, page 262) 
co 
S(z,a) = / t°—! sint dt. 
z 


Hubbell rectangular-source integral (see Gabutti et al. [12]}) 


b 
,b) = 0 _ de 
(a,b) [i (sks) ses 


Incomplete Gamma function (see Abramowitz and Stegun [1], 6.5.3, page 260) 
(a, 2) =| to 1e~* dt. 
z 


Generalized inverse tangent integral (see Lewin [21], Chapter 3, pages 61-90) 


x -1 
Tia(s,0) = | tan) ie 
0 t+a 


Hurwitz function (see Spanier and Oldham (26], 64:3:1, page 655) 


t’-} oa 
: —— dt. 
C(v; u) = rofl: 1 =_— a, eee 
Repeated integrals of Ko (see Abramowitz and Stegun [1], 11.2.10, page 483) 


0° —zcosht 
Ki,(z) -/ —— dt. 


cosh’ ¢ 


Kummer’s function (see Lewin (21], page 178) 
z n—-l 
An(2) = i log” tl at. 
0 


Legendre function of the first kind (see Spanier and Oldham [26], 59:3:1, page 
583) 


oo v 
P,(z) = i z++/2?-—I1cost| dt. 
7 Jo 


Legendre function of the second kind (see Spanier and Oldham [26], 59:3:2, page 


583) 
Qi(z) = [ [z + 2? — Leosht| v= 


Pearcey integral (see Kaminski [18]) 


oo Fe) 2 
P(e.a) = | exp47{ —+2—+ yt } dt. 
a8 aa 


Polygamma function (see Abramowitz and Stegun [1], 6.4, page 260) 


-—at 


uy (2) at (-1)"*? 4" 
1-t 


0 


dt. 


39. Look Up Technique 177 


Log-sine integral of order n (see Lewin [21], page 243) 


6 
Ls,(@) = -[ log”? 
tr) 


_ 6 
2sin 5 dé. 


Extended log-sine integral of the third order of argument 6 and parameter a (see 
Lewin [21], page 243) 


@ 
Ls3(0,a) = -| log [2sin | log |2sin (5 + $)| dé. 
A 2 2° 2 
Sievert integral (see Abramowitz and Stegun [1], 27.4, page 1000) 


@ 
2(c,6)= [ e TC? dg, 
0 


Polylogarithm of order n (see Lewin [21], page 169) 
Lin(z) = i vino) dt. 


0 


Struve function (see Abramowitz and Stegun [1], 12.1.7, page 496) 


Gp 
H,(z) = weal sin(z cos 0) sin?” 6 dé. 


Modified Struve function (see Abramowitz and Stegun [1], 12.2.2, page 498) 


2(5) pr 
L.(z) = —_—_"—""- sinh(z cos @)sin*” 6 dé. 
= eo [ sianczcos0) 


Voigt function (see Lether and Wenston [20]) 


yf? et 
V(z,y)= 4%) —* —at 
ah 4 ener, 


Weber function (see Abramowitz and Stegun [1], 12.3.3, page 498) 
E,(z) = a sin(v@ — zsin@) dé. 
0 


Unnamed integral (see Bonham [5]) 
1 
fon(z) = ap f P2,(t) sin zt dt. 
0 


Unnamed integral (see Bonham [5}) 


1 
fan41(2) = caer [ Pon+1(t) cos zt dt. 
it) 
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Unnamed integral (see Chahine and Narasimha [6]) 


ad 2 
z(z,u) -[ tre (Eu) —2/¢ ae, 
0 
Unnamed integral (see Glasser [13]) 


I,(z) = ic t’(1 — t)”|sin xt| dt. 


0 


Unnamed integral (see Nagarja [23]) 


P en 
2(x,p) -[ dt. 
, 9 ttz 


Integrals with Three or More Parameters 


Incomplete Beta function (see Abramowitz and Stegun [1], 6.6.1, page 263) 
z 
B,(a,b) = / t°-1(1 — t)?7* at. 
0 


Elliptic integral of the third kind (see page 147) 
dt 


sin @ 
n(én,k) = | Geet) Jamal Be 


Double Fermi-Dirac integral (see Fullerton and Rinker [11}) 


oo t’ oo 3” 
Ay yp (a) = dt ——_—_ ds ——_—_. 
vn ) i 1 =| 1 +e°"* 


Generalized Fermi-Dirac integral (see Pichon [24]) 


oo ¢* ma A 
Filme) = f ve 


“ppt 


Gauss function (see Spanier and Oldham [26], 60:3:1, page 600) 
__ Te) oreo | a to dt 
F(a, b,c; : 
(0 G2)= Tore J, (a P(1 — at 
Incomplete hyperelliptic integral (see Loiseau, Codaccioni, and Caboz (22}) 


x 
H(a, X; 2, An) -/ 
0 


a— Aor? — Anz” 
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Hypergeometric function (see Abramowitz and Stegun [1], 15.3.1, page 558) 


1 
F(a,b,c;z) = rarena f ed = ana | ~ tz)7* dé. 


Confluent hypergeometric function (see Abramowitz and Stegun [1], 13.2.1, page 
505) 


T(b) 


1 
zt,a—1 b-a-1 
Te — aT (a) j, e291 (1 — t) dt. 


M(a,6,c) = 


Confluent hypergeometric function (see Abramowitz and Stegun [1], 13.2.5, page 
505) 


U(a, b, c) = ry | e 9-11 re) aaa dt. 
0 


Lerch’s function (see Spanier and Oldham (26], 64:12:2, page 661) 


t’-} e 
© —- dt 
(t3;v;u) = rol aoe 


Generalized log-sine integral of order n and index m (see Lewin [21], page 243) 


6 
Ls”) = -| 6™ log" ™—? 2 sin | dé. 
") 
Selberg Integral (see ages (3}) 


Sasi) = | 1G (1 —2,)? I] ja; —2;|"dtg A... Adan Adan. 
0,1] —? 523 3<i<j<N 
Complex Selberg Integral (see Aomoto [3]) 


se(a.7)= (5) [ts gure TT la -asl” 


[0,1]2(N—2) | 3<i<j<N 
dz; Ndz3A...Adzn Adzn. 


Shkarofsky functions (see Robinson [25]) 


i nn ; at” 
F,(z,a) = -f i? exp (ix - oy) ; 
Wu’s integral (see Fettis (10)) 
Jp,y(€) = eee ees dz. 
0 
Unnamed integral (see Anderson and Macomber (4]) 


H(p, q) = / dt t"-? exp(-5(¢ —p)’ = 2) ; 
0 


180 III Exact Analytical Methods 


Unnamed integral (see Cole (8]) 


oo 
I(y, 2,3) = i, exp[—s(t+ ycost — zsint)] dt. 
0 


Unnamed integral (see K6lbig [17]) 
1 
z(v,A,m) = i a”—*(1 —2)~* log™ dz. 
0 
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40. Special Integration Techniques 


Applicable to There are many specialized integration techniques, each 
of which works on a special class of integrals. 


Integrands involving solutions of second order differential equations 
Consider the integral 


pe | CORTON. (40.1) 


where y; and ye are linearly independent solutions to the ordinary differ- 
ential equation: y” = Q(x)y. (Note that the Wronskian of y; and yo is a 
constant; W(y1,y2) = c #0.) For this method to work, we require that f 
be homogeneous of degree —2, that is f(ay1,ay2) = a~?f(y1, ye). In this 
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case we find 


r= [ fn(e),ua(2)) de = ff (1,2) Maw 


‘ c (40.2) 
=-/ f(l,u)d 

=f t0,u) du 
where u = yo/y1. 
Example 1 

The following example is from Ashbaugh [3]. The integral 
pe lo“ sin? x —dz 
cos‘ z + cos zsin® x 


can be evaluated by identifying y, = cosz and yo = sin z as being solutions 
to y”’ + y= 0. Hence, we write J as 


ees — w= [5 ys YY — Vi Ye Bs 
yi + ar. yi tye 1 


2 
=| bs 3 du 
l+u 


= Flog|i+u5/+C 


= 5 log 


oe (==)" +e 
= dlog|1+ tan? z|+C 


where C is an arbitrary constant. 


Example 2 
The following example is from Ashbaugh [3]. The integral 


dz 


= (Ai(z) — i Bi(x))? 


(where Ai (Bi) is the Airy (Bairy) function) has the form of (40.1), with 
yi(z) = Ai(x) —¢Bi(z) and y2(r) = Bi(x). We can write K as (recall that 
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Ai and Bi satisfy Airy’s equation: y” = ry) 


7 dz = [ Beane 
0 (Ai(z)-iBi(z))? Jo mt yf 

= i 7 ldu 

z2=0 
= (u)[z=0° 
_ Bi(x) Me. Poe 
Ai(xz) — 7 Bi(z) 
i- v3 


4 


Integration of Rational Functions 
A rational function can always be integrated into a sum of rational 
functions and logarithmic (or arctangent) functions. Using D(X) and N(z) 
to represent polynomials, a rational function can be written using partial 

fractions as 
N(z) 


° * N i 
f(z) = D(a) = (polynomial in x) + 2 CSET 


where the {r;} are the roots of D(x) = 0 (assumed here to be distinct). 
This integrand can be directly integrated to obtain 


ae N(ri) 
[t@ dx : (polynomial in x) dz + ips =r jas(t2 = 79) dz 
beet N(r;) log(x — ri) 
(different polynomial in z) + > Tyga(rs — 79) ; 

(40.3) 
This is formally correct, even when the roots are complex. Since logarithms 
and arctangents are related by log(u — iv) = 2itan7!(u/v), the expression 
in (40.3) is always applicable. 


Example 3 
dz 
ot-1 ie ae ee 
= dlog(x — 1) + }log(z +1) + Z log(x — i) + # log(x + ¢) 
= 1, 2o1 - ve £. 
4 zr+1 2 


For the case when some of the roots are repeated, see Stroud [6]. 
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Use of Infinite Series 

Sometime an integral may be evaluated by expanding the integrand in 
a series, integrating term by term, and then re-summing the result. This 
technique may also be used to obtain an asymptotic expansion, see Wong [7] 
for details. 


Example 4 

* sinar 
e*—-1 

denominator, and interchanging integration and summation results in 


I= > / e~"™ sin ax dz 


Consider the integral J = dz. Formally expanding the 


where we used Jolley [4] to recognize the cotangent sum. 


Example 5 
Consider the integral 


ye / * naa? Ji(Bax) dx (40.4) 
0 


where J; is a Bessel function. From Abramowitz and Stegun [1] 9.1.10, we 
note that 


_ Bu & (-36"2?)" 
Jy (8x) = = dX "AED (40.5) 


Using (40.5) in (40.4), and interchanging orders of integration (see page 109), 


results in 
1 2 k foe) 
mes (-4) free 
0 


p\* kt 
met 7) Fatt! 


El c) eH 


-5(-<0 


where we had to recognize the series for the exponential function. 


f= 


“sls eee 
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Series Transpositions 
Squire [5] presents an elegant technique using series expansions and 
re-summing. An example will demonstrate the general ideas. 


Consider the integral J = wane dz. The infinite integration region 


0 
can be written as an infinite sum of finite integration regions, and then 
each finite region of integration can have the variables changed: 


So plkt)e/2 sin g du 
 e / —dr= [ ‘sin (+ +u) —— 
Ds, 3 tag 


: ka . ka 
co 6pr/2 { sinucos—  cosusin > 
ey Ag comer lanes 


tka +u tka +u 
; kn ee 
CO pn /2 sin cos ~>- sin usin — 
= >| 4 a du 
k=0°9 gkn +u s(k+1)7-u 
/2 oo cos Be sin ode 
nT — —— 
= du si aa 2 
ji sins 2 Tinta Wk+l)n—u 
a{2 fos) 1 1 1 1 
- | du sin u (|>- +f +| = +...) 
: =o MMOS eh ean liga 
n/2 TT i : 
=| du sinu (=) = | du =~ Utacre { ee CY] 
1) sin u 0 2 


where the changes of variables used were u = c—k7/2 and then u = 7/2—u. 
The final summation was found in Jolley [4], summation #769. 


Note 
[1] Arora et al. [2] notice that the two properties 


(A) Jo f(a) dz = fo” f(z) de + Jo” fla - 2) de 

(B) fp f(z) dz = fp f(a-2)dz, 

if used cleverly, can evaluate some sophisticated integrals. They evaluate 
log z 
1+2° 


the integral [ 5 dz = -7 to demonstrate this. 
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41. Stochastic Integration 


Applicable to Integrals in which the measure involves Brownian noise. 


Yields 
Information on how to evaluate Ito and Stratonovich integrals. 


Idea 
Different types of stochastic integrals exist, depending on how points 
are chosen in a limiting process. 


Background 

Suppose that w(t) is the Wiener process and G = G(t) = G(t, w(¢)) 
is an arbitrary function of w(t) and the time t. (See the Notes section for 
information about the Wiener process.) The stochastic integral 


I= [ G(s) dw(s) (41.1) 


is defined as a kind of Riemann-Stieltjes integral. That is, first divide the 
interval [to,¢] into n sub-intervals: to < t) < te < +++ < tps < ty =F. 
Then choose the points {7;}, for i = 1,2,...,n, such that 7; lies in the i-th 
sub-interval: ¢;-1 < ™% < t;. The stochastic integral J is now defined as a 
limit of partial sums, J = limpoo Sn, with 


Sa = >_ G(r, w(7:))[w(ts) — w(ts-2))- (41.2) 


t=1 
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Note that this limit depends on the particular choice of the intermediate 
points {7;}. 

Consider, for example, the special case of G(t) = w(t). Then we find 
the expectation of S, to be 


E[Sp] = E | > w(7:)[w(ts) — w(ti-1)] 
t=1 


n 
= [min(7;,t;) — min(7;, t;-1)] 
t=1 
nr 
i= 


= > (ti — ti-1). 
1 


If, for example, we take 7; = at; + (1 — a)t;-1, where 0 < a < 1, then 
E|[S,] becomes 


n 


E[Sa] = S_ (ti - ti-1)a = (t — to)a. (41.3) 


i=1 


Clearly, the value of S, (and hence J), in this example, depends on a. 


For consistency, some specific choice must be made for the points {7;}. 
For the Ito stochastic integral we choose 7; = t;-  (i.e., a = 0 in the above). 
We show this by use of the notation f. That is 


i G(s, w(s)) dw(s) = ms-lim >> G(ti-1, w(ti-1))[w(ti) - v(t} , 
0 s=1 


(41.4) 
where ms-lim refers to the mean square limit. 


188 III Exact Analytical Methods 


Example 
Suppose we would like to evaluate the Ito stochastic integral 


{ w(s) dw(s). (41.5) 
to 


If we write w; for w(t;) then (41.4) becomes (using G(s) = w(s)) 
Yj, w(s) dw(s) = ms-limasoo Sn with 


nr 
Sr = So wis [wi — wi-1] 


t=1 


n 
= > wi-1 Au; 


= 3» [(wi—a = Aw;)? a (wi-1)? 7 (Aw;)?] 


t=1 
= 3) (lw)? - (wi-s)?] - $ (Aw)? 
t=1 i=l 


= } [w?(t) -— w?(to)] — 3 So(Aw;)? 
t=1 


where Aw; = wi — Wit. Now the mean-square limit of § )>y,(Awi)? can 
be shown to be 5 A(t — to). Hence, 


| w(s) dww(s) = ms-lim {3 [w*(t) — w(to)] - 3 Scawh (41.6) 


t=1 
= 3 [w?(t) — w?(to) — (t - to)] . 


Note that the result is not the same result that we would have obtained 
by the usual Riemann-Stieltjes integral (in which the last term would be 
absent). Note that the expectation of (41.6) yields the value 0, which is 
the same value as given by (41.3). 
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Notes 

[1] The Wiener process is a Gaussian random process that has a fixed mean 
given by its starting point, E{w(t)]| = wo = w(to), and a variance of 
E|(w(t) — wo)?] = t — to. From this we can compute that E[w(t)w(s)] = 
min(t,s). The sample paths of w(t) are continuous, but not differentiable. 

[2] We define the Stratonovich stochastic integral (indicated by use of the 
notation $) to be (see Schuss (2]) 


f G(w(s), 2) dw(s) 


= ms-lim 3 G (Ore), ts) {w(ts) — ots} 


t=1 


[3] It can be shown that the Stratonovich integral has the usual properties 
of integrals. In particular, we have the fundamental theorem of integral 
calculus, 


{ f'(w(s)) dw(s) = f(w(t)) — f(w(to)), 


integration by parts, etc. Taking the Stratonovich integral of the integrand 
in (41.5) results in ,, w(s) dw(s) = 5 4 [w?(t) - w?(to)]. 

[4] For arbitrary functions G, there is no connection between the Ito integral 
and the Stratonovich integral. However, when x(t) satisfies the stochastic 
differential equation dr(t) = a[x(t), t] dt + b[x(t), t] dw(t), it can be shown 
that (see Gardiner [1]}) 


{ b[z(s), 8] dw(s) = j blx(s), 8] dw(s) + 5 [ b[x(s), oj Melo), ae 


to to 


This relates, in a way, the Stratonovich integral and the Ito integral. 

[5] Stochastic integration can also refer to the (ordinary) integration of ran- 
dom variables. Since the linear operations of integration and expectation 
commute, the following results are straightforward to derive. Let {X(t)} 
be a continuous parameter stochastic process with finite second moments, 
whose mean (m(t) = E[X(t)]) and covariance (K(s,t) = Cov[X(s), X(t)]}) 
are continuous functions of s and t. Then 


e| f xwal = [ ma 
Pp [xa | = ff axexeyaas 
Var [[ xwal = [ [ xenatas 
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[6] Suppose that x(t) is a random process that satisfies the stochastic differential 
equation dzr(t) = a[x(t), t] dt+b[x(t), t] dw(t). If we define a(z, t) = a(x, t)— 
4b(x, t)Ob(x, t)/Ox, then the solution to the stochastic differential equation, 
z(t), can be shown to satisfy (see Gardiner [1)) 


z(t) = x(to) + f a[z(s), s] ds +f b[x(s), 3] dw(s). 


to to 
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42. Tables of Integrals 


Applicable to Specific definite and indefinite integrals. 


Yields 
An exact evaluation. 


Idea 
The evaluation of many integrals has been tabulated. 


Procedure 

Compare the integral of interest with the tables in the references. 
These tables typically include indefinite and definite integration of both 
elementary and special functions (including, for instance, Bessel functions 
and hypergeometric functions). 


Example 

Suppose that we would like to determine the value of the definite 
integral I = f, */2 tan¢xdx. Some tables have J tabulated more or less as 
written, some tables give only the indefinite integral, and other tables give 
information that can be manipulated to yield the value of J. We find: 


e Beyer [3] has a recursion for the nF integral in number 423: 
n-la 
ay: 1) -| (tan"—? ax) dz. 
e Bois [4] lists several recursions for an integrand similar to that 
in I. One of these (on page 133) i be 


sin™ x sin”) m-—1 fsin™'z 
“are hone es 
cos” (n—1)cos*""*z n-1J cos” ‘2 


i, (tan” ax) dz = 
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Dwight [5] has a recursion for the indefinite integral in number 
480.9: 


n—1 


t 
[tour 2ae = + - [tou waz. 


In Gradshteyn and Ryzhik [7], the definite integral appears as 
number 3. O22. at 


te*# edz = 5 sec [when] |Rep| <1. 
0 


In Gradshteyn and Ryzhik [7], the indefinite integral appears as 
numbers 2.527.2, 2.527.3, and 2.527.4: 


te? a oy 
tg? edz = oer ia tg’-“xdx [when] p#1l 


n k—-14,,.2n—2k+2 
-1 tg x 
[grt ede — 


n—2k+1 
2n on k- it _ n 
[rs sana yt 4) me oe ie 
In Grobner and Hofreiter 18} the definite integral appears as num- 
ber Sores 


te’ cdr = ~~ [when] -1<A<1. 
0 TT 
2cos —- 


In Prudnikov, Brychov, and Marichev [12], the integral appears 
as mupper 2p 20.0 


tg’ x dx [when] |Rep| <1. 


_ T 

0 ~ 2cos(um/2) 

In Prudnikov, Brychov, and Marichev [12], the indefinite integral 
appears as numbers 1.5.8.1, 1.5.8.2, and 1.5.8.3: 


[exp dz = = - [ (ex)? dz 


2n ais k 2n—-2k+1 
[(es) dr = 3 -1)"5 er (ts) 
+(-1)"z 
= 1 
2n+1 = _1\k 2n—2k+2 
/ (tgx)ir" de * DA 1) on aka te) 


+(—1)" log | cos z|. 
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Notes 

[1] Realize that the same integral may look different when written in different 
variables. A transformation of your integral may be required to make it look 
like one of the forms listed. 

[2] It is not always clear that having a symbolic evaluation of an integral is 
more useful than the original integral. For example, it is straightforward to 
show that 


_ f[* at Pe x +cV2+1 
re) = [ 1+¢* =e (GE) 
+e [ta (ss) + 1m (=+)]. 


Given a specific value of z, numerically determining I(x) by using this 
formula requires the computation of logarithms and inverse tangents. In 
some cases it might be easier to approximate J(z) numerically directly from 
its definition. 

[3] It is an unfortunate fact that a not insignificant fraction of the tabulated 
integrals are in error. See, for example, Klerer and Grossman [9]. 

A common error is to produce a discontinuous antiderivative when 

a continuous integral is available. For example, the symbolic computer 
language REDUCE produces (see page 117): 


1 f _ de 
2+ cosz 


2/73 ( sin z ) 2/3 ( V3sinz ) £ 


= ——— arctan (———— } + —— arctan | —————_ } + —. 
aeeeae \ cosa +1 - ea 3(cos x + 1) Ta 


3 3 


This (correct) antiderivative is continuous, yet Abramowitz and Stegun [1], 


4.3.133, report the discontinuous result T= cae arctan tan(z/2) These 
VB 
antiderivatives agree on the interval —7 < x < 7, but J is periodic while I 


is not. 

[4] If an integral is recognized to be of a certain form, then appropriate tables 
may be used. For example, an integral of the form I = f° f(x)e~** dz 
represents a Fourier transform of the function f(z). Hence, a table of Fourier 
transforms (such as Oberhettinger [11]) might be an appropriate place to 
look for an evaluation of J. 

[5] Note that Oberhettinger [11] has tables of Fourier transforms, Fourier sine 
transforms, and Fourier cosine transforms. 

[6] All of the integral evaluations in Gradshteyn and Ryzhik [7] are referenced, 
so that one level of checking against typographic errors can be performed. 
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IV 


Approximate Analytical 
Methods 


43. Asymptotic Expansions 


Applicable to Definite integrals that depend on a parameter. 


Yields 

An asymptotic expansion. 
Idea 

When a parameter in an integral tends to some limit, it may be possible 
to find an asymptotic expansion of the integral that is valid in that limit. 
Procedure 

There are several general asymptotic expansion theorems that can be 
used to determine the asymptotic nature of an integral; we enumerate only 
a few. 


Theorem (Bleistein and Handelsman [2], page 71): Define 
I(A) = f h(t; A) f(t) dt, where f(t) is continuous for n = 
0,1,...,N +1, and f*?)(t) is piecewise continuous in the 
interval [a, b]. If 

[a—"-Y(t;.)| < an(t)oa(A), forn=0,1,...,N +1, 


195 


196 IV Approximate Analytical Methods 


where the functions {an(t)} are continuous on the interval 
[a, b) and the functions {¢,(z)} form an auxiliary asymptotic 
sequence as A — Xo, then 


N 
TA) ~ $5 Sn(A), as A Ao, (43.1) 


n=0 
where the S,,(A) are defined by 


Sn (A) = (-1)” [Ff (BAA "YB; A) — fF (a)hO"-Y'(a;d)] . 


Special Case 1 
Under appropriate smoothness and boundedness conditions, the inte- 
gral I(A) = f : h(At) f(t) dt has the asymptotic expansion 


N n 
1(a) ~ SAE [pe oynt-2-D (aby — F(Q)n-*-Y (Aa)] 


n+l 
n=0 r 


as A — 00. 
Special Case 2 

Under appropriate smoothness and boundedness conditions, the inte- 
gral I(A) = f i et f(t) dt (which is a special case of Special Case 1), has 
the asymptotic expansion 


N 


I(A) ~ B RF [71 (be# ey f™)(a)e| 


as A — oo. 
Special Case 3 

Under appropriate smoothness and boundedness conditions, the inte- 
gral I(\) = f : e— f(t) dt (which is a special case of Special Case 1), has 
the asymptotic expansion 


e742 


N 
IQ) ~ Do sar f(a) 


n=0 


as A — 00. 


Watson’s Lemma (Bleistein and Handelsman [2], page 103, 
or Wong [5], page 20): If f(t) is locally absolutely integrable 
on (0,00), as t — 00, f(t) = O(e%) for some real number 
a, and, as t — 0+, f(t) ~ > _,emt*™, where Re(am) 
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increases monotonically to +oo as m — oo, and Re(ao) > —1, 
then, as A — 00, 


ee — CmI' (am +1 
/ e At F(t) dt ~ y ont on). 
0 


m=0 


Theorem (Bleistein and Handelsman [2], page 120): Let 
h(t) and f(t) be sufficiently smooth functions on the infinite 
interval (0,00) having the asymptotic forms 


oo N(m) 

h(t) ~ exp (—dt”) > > Cmnt"™ (log t)”, 
m=0 n=0 
co N(m) 

f(t) ~ exp(—at*) 5> S> pmnt™°™ (log t)”, 
m=0 n=0 


with some conditions on the range of the parameters appear- 
ing in the expansion. Let the Mellin transforms of h and f 
be denoted by M[h;z] and M[f;z] (see the Notes). If some 
technical conditions are satisfied, then 


oo 
[ h(At) f(t) dt ~ — > res (A7* Mh; z] M[f;1 — z]) (43.2) 
0 z 
represents a finite asymptotic expansion as A — oo with 
respect to the asymptotic sequence {A~° (log A)"5~™}. The 
expression in (43.2) represents a sum of the residues over all 
of the poles in a specific region of the complex plane. 
Bleistein and Handelsman [2] simplify the expression appearing in 
(43.2) in five different cases, depending on the values of the parameters. 


Example 
If J(A) = f° f(t) dt, then A(é;) = t* f(t) and so 
prtnti 
TTj-0(A +3 +1) 


forn = 0,1,... where we have chosen the limit of integration in the repeated 
integrals of h to be zero. From (43.1) this results in the following asymptotic 
expansion: 


A*—Y (6A) = 


Jd a |] (rn) b prtaetl — ¢(n) Atn+1 43.3 
(A) ~ a reTEST [> () fr (aja"*1] (43.3) 
whenever f satisfies the hypotheses of the theorem. If f were a polynomial, 
then the expansion in (43.3) would be the exact evaluation for J(A). 
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Notes 

[1] The Mellin transform of the function f(t) is M[f; 2] = J>° t?—" f(t) dt which 
can be interpreted as the (z — 1)-st moment of f(t). The so-called bilateral 
Laplace transform of g(t) is the Mellin transform of f(¢) = g(— log?). 

[2] Consider the integral J = f. ef (2) 9(z) dx in the limit 4 > oo. An asymp- 
totic expansion methodology for J is given by 
(A) the method of steepest descents (page 229) when f(z) is complex, 

(B) Laplace’s method (page 221) when f(z) is real, 
(C) the method of stationary phase (page 226) when f(z) is purely imagi- 
nary (no real component). 

[3] In asymptotic formulas, it is important to describe fully the region in which 
a parameter is tending to a limit. Error estimates should also be supplied 
with an asymptotic formula. For example, the complementary error function 
has the following expansions as + — oo: 


oo 


_7? » (2k — 1)! 30 3m 
erfc(z) ~ e 20 okt te+i for =a <argr< 7 
1 (2k — 1)! 7 7x 
_ k mae ee 
erfe(x) ~ /7+e~* 2) Fri err for Z <argz< 7 
(43.4a-6) 


Note that these expansions both apply in the region of overlap, 7/4 < 
argz < 37/4. In this overlap region equation (43.4.a) has a large error 
while equation (43.4.b) has a small error. 

[4] Wong [5] (page 22) has a generalized Watson’s lemma: 


Define I(A) = ee f(t)e~** dt, and assume that I(Ao) ex- 
ists. If f(t) ~ )o_, cmt*™ as t — 0 along argt = 7, where 
co }«6CmI (@m + 1) 


Reao > Oand Ream+:1 > Ream, then I(A) ~ m=0 yom ti 


[5] Salvy [4] has created a package for automatically determining the asymptotic 


expansion of some classes of integrals, using the symbolic computer language 
MAPLE. Salvy gives the following sample outputs from his program: 


1 
co sin (=) - 
-/ t} apm 74 ri _ let _ ot (=) 
0 


t(t + 2) oe ges ge ge NA 
oo —zt 
e 1 1 2 6 
+ Bu(a)= f gee te ie ge 
“Vite logt 4, _va(y + 2log2) | mlogz , vm(4~ 27 ~ 41og2) 
0 1+tz 7 gel? x 


as x — oo. Here, y is Euler’s constant. 
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44. Asymptotic Expansions: 
Multiple Integrals 


Applicable to Multidimensional definite integrals that depend on a 
parameter. 


Yields 
An asymptotic expansion. 


Idea 
When a parameter in an integral tends to some limit, it may be possible 
to find an asymptotic expansion of the integral that is valid in that limit. 


Procedure 

It is difficult to state concisely very much about the different asymp- 
totic behaviors that are possible in multiple integrals. In this section we 
will only focus on the integral 


10a) = ff #0 go(x) ax (44.1) 


when ¢ is a real function and 4 is real with |A| — oo. Integrals of this 
form are known as integrals of Laplace type. (The other interesting case 
that occurs in applications is when is purely imaginary with |A| — 00; 
this leads to integrals of Fourier type.) Here, D is some (not necessarily 
bounded) domain in n-dimensional x space. 
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Laplace Type Integrals 

We presume that ( is real and that D is a bounded simply connected 
domain. The boundary of D, denoted by I, is an (n — 1)-dimensional 
hypersurface. We assume it can be represented as 


[:x(o), o =(04,..-,On-1) 


where o takes values in the set P. We presume that ¢, go, and 2z;(o) are 
sufficiently differentiable for what follows. 

There are now two cases, depending on where the maximum of ¢ 
appears in D. 


Maximum on the Boundary 

We presume that the maximum of ¢ appears on the boundary D at 
the unique point x = Xp. 

Let N be the outward normal to I’, and let dd be the differential 
element of “surface area” on [. Now define the gradient operation, V = 
(O2,,---,O2,), the functions ¥(7) = ¢(x(o)), Hj = 9;V¢/|V¢|?, and 
9j41 = V-H; (for j = 0,1,...). Then an exact representation of the 
integral in (44.1) is given by (see Bleistein and Handelsman [2], page 332) 


M-1 (-1)™ 
IQ) = - $0 (-a)-9 [ (H; -N)e** dd + Su [ gue’? dx (44.2) 
j=0 
for M = 2,3,.... 


The first terms in this expression are lower dimensional integrals for 
which asymptotic expressions may be found (recursively, if necessary). The 
last term can be bounded and will become the “error term.” 

For the particular case of n = 2, we can parameterize the boundary 
by I: (#1(s),22(s)) where s = 0 corresponds to the maximum at x = Xo. 
The leading order term in (44.2) (e.g., the 7 = 0 term) can then be written 
as 
27 


d* |¥"(0)| 


if the maximum of WV at s = 0 is simple (so that (0) < 0). If «(0) is the 
curvature of [' at x = xo, then (44.3) can be further simplified to 


I(A) we) go (co) 


-1/2 
bz, 2, 2, — 22,2 $2, Peg + bxy2, >, -K Iva" 


I(A) ~ 9%) (Ho-N)|_, (44.3) 


s=0 


x 


X=Xo 
(44.4) 


where the minus (plus) sign holds when [ is convex (concave) at x = Xo. 
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Maximum Not on the Boundary 

We presume that the maximum of ¢ appears in the interior of D at 
the unique point x = Xo. 

Near x = Xo we can expand ¢ in the form ¢(x) — ¢(xo) © $(x — 
Xo).A(x — X9)7, where the matrix A = (aj;;) is defined by aj; = ¢z,2, (Xo). 
Let Q be an orthogonal matrix that diagonalizes A, i.e., 


Ai 0 
QT AQ = ( i 
0 An 


Then define the variable z by (x — x9) = QRz? where the matrix R = (r;;) 

is defined by rij = 6;; |Ai|~'/?. Now the functions {h;} are chosen so that 

Cy = hy(z) = 2% + o(|z|) (as |z| > 0) and DY, A? = 2(6(x0) — o(x(z))). 
With these futictinae we define the Jacobian ge) oe and 


O(C1,--- Sn) 
then go(x(¢))J(¢) = Go(C) = Go(0) + ¢- Ho. Then we have the recursive 


definitions G;(¢) = G;(0) + ¢- H;(¢) and Gj41(¢) = V- H;(¢). (Note 
that there is an ambiguity in the {H,}, this is not important.) Finally, the 
approximation to I(A) is given by (see Bleistein and Handelsman [2], page 
335) 


M-1 

I(A) ~ eo) b A~4G;(0)Z[1] + *atew6] : (44.5) 
j=0 

where Z[k(¢)] = J, (¢)exp(—3A¢-¢) d¢. Note that (44.5) is not an 

exact representation, since M exponentially small boundary integrals have 

been discarded. The leading order term in (44.5) can be written as 


Ad(Xo) n/2 
e 20 
10) (=) 90(Xo)- (44.6) 
|det (dx,2; (xo))| 
For the particular case of n = 2, the result in (44.6) can be written as 
2 A$(Xo) 
IA) ~ an go(Xo)eo (44.7) 


bey 2, (x0 )¢z222 (xo) _ $2 xy (xo) 


Example 1 : 
Consider the two-dimensional integral J(A) = f [ e*“*-¥) dz dy where 
D 


D is the unit circle. This integral has g9 = 1 and ¢ = x — y?. In D, the 
maximum of ¢ is at x9 = (1,0). Since this a boundary point of D, (44.4) 
is the appropriate formula to use. The only nonzero terms that appear in 
(44.4) are: go(xo) = 1, ¢(X0) = 1, d2(xo) = 1, «(xo) = 1, and |V¢(xo)| = 


1. Using these values results in the approximation J(A) ~ e4,/27/A3. 
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Example 2 — 
Consider the two-dimensional integral K(A) = f f e*@-* -¥) drdy 
D 


where D is the unit circle. This integral has g9 = 1 and ¢ = 2 — 2? — y?. 
In D, the maximum of ¢ is at xo = (0,0). Since this an interior point of D, 
(44.7) is the appropriate formula to use. The only nonzero terms that 
appear in (44.7) are go(xo) = 1, $(xo) = 2, ¢zz(xo) = —2, and dyy(xo) = 
—2. Using these values results in the approximation K(A) ~ we?4/). 

For this example, the integral can be computed exactly. We find 


Qn pl 1 2. _ oA 
K(A) = 2-5 dp dQ = —LeX2-7)| = $2 
0 Jo r 0 A 
err 
~ se ta as A > ov. 


Notes 

[1] Bleistein and Handelsman [2] also describe asymptotic results for multidi- 
mensional Fourier integrals. 

[2] Consider the integral J(A) = ff f(x)e"**™ dx, where ) is a large parameter. 


R? 
At caustic points (also known as turning points), defined by 


2 
V¢(x0)=0 and det ( oo ) = 0, 


the classical stationary phase techniques do not apply. For caustic points 
where the Hessian determinant vanishes, but the Hessian is not identically 
the zero matrix, there are several canonical forms of physical interest. These 
include the following possibilities for ¢(z, y): 
d(z,y)=a2°+y’ fold 
¢(z,y)=2°+y" cusp 
d(z,y)=2°+y’ swallowtail 
o(z,y) =2°+y’ butterfly. 
For caustic points where the Hessian is identically the zero matrix, the 
canonical forms for ¢(z, y) (for co-dimension less than 5) are 
é(x,y) =2°—szy’ elliptic umbilic 
d(z,y)=2°+y° or 2°+2y? hyperbolic umbilic 
o(x,y) =2*+<2y? parabolic umbilic. 


See Gorman and Wells [4] for details. 
[3] Briining and Heintze [3] derive an asymptotic expansion for the integral 


a 
x | x? log’ xf(x) dz, as s > 0+. 
four \ 8 
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[4] McClure and Wong [5] derive an asymptotic expansion for the integral 


x* 
/ o(=) x? f(x) dz, as s — OT. 
lore \ 8 
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45. Continued Fractions 


Applicable to Integrals for which a continued fraction can be found. 


Yields 
A numerical approximation of an integral. 


Idea 
If a continued fraction can be found for an integral, then it may be 
used to approximate the value of that integral. 


Procedure 
A continued fraction is an expression of the form 


co a; a 

i=1 0; a2 
a3 
bo + —————_ 

: b3+.... 

Here, a; is called the k-th partial numerator and 5, is called the k-th partial 
denominator, for k = 1,2,...,00. For typographical convenience, and also 
to save space, continued fractions are sometimes represented as 


a>| a3| @, a2 a3 


a;| 
—-+—-e+... or as —— — ..... 
|bo lbs by+ bo+ 634+ 


ou + 
[ba 
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We define 


eae .-- $Qe 
to be the k-th convergent of the continued fraction J. The continued 
fraction is said to converge if the sequence {c,} converges. 

In many cases, an integral may be written as a continued fraction. 
Partial convergents of the continued fraction then yield approximations to 
the original integral. 


Notes 
[1] Given {a,} and {b,}, define the sequences {p,} and {g.} by the recurrence 
relations gx = beqx—1 + @eQe—1 and pr = bepe—1 + axpe-1 for k = 1,2,.... 
The initial values are given by p-1 = 1, po = 0, g-1 = 0, and go = 1. Then 
Ce = pr/qe for k = 1,2,.... Note that this relates continued fractions to 
recurrence relations. 
It might be easier to observe that the three-term recurrence relation, 
Yn + QnYn+1 + OnYn+1 = 0, is formally equivalent to the continued fraction 


Yn = bn basa 


Ynt+1 . An+1— @n+2— 
[2] From a Taylor series in the form F(z) = )\¢-, diz~“*), a z-fraction, which 


is a continued fraction of the form 2 _ xu _ ot - # —..., may easily 
be constructed. By defining F(z) = )\y-y di+nz +”) = cx (z), where 


d 
cx(e) = tl — Fal _ Saal — al — so _ fs,x| ee 


we Obtain the recurrence relations 
€j-1,k+1 + fjngi = Fin + ej,n for e 
Sj,e4+1€j,k4+1 = Cjkfj+i,k for f 


with eo. = 0 and fix = dy4i/d,. After determining the {e;,., fj}, we 
find e; = e;,0 and f; = fj,0 for j > 1, and e9 = do. This is known as the 
QD (for quotient difference) algorithm. See van der Laan and Temme [3] 
for details. 

Using this algorithm and the asymptotic formula 


a he 2z 2f1 1 =, 3 
erfele) = | a" dt ~ =e (se -aatas---)s 


we can derive a continued fraction approximation to the erfc function: 


VT 6?” erfe(z) = Al. alg al 3hy, al 
@ [27 2 fz | \z 
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46. Integral Inequalities 


Idea 
Some integrals may be easily bounded by known theorems. 


Procedure 


Given an integral that is to be bounded, a formula should be located 
that has the desired form. This is not a straightforward process. 


Example 


Suppose we would like to bound the integral J = pe a 
xz 

If we write this integral as J = i f(x)g(z) dz, with f(z) = e~* and 

g(x) = 1/V1+ 22, then we note that both f and g are decreasing functions 

on the interval [0,1]. Hence, Tschebyscheff’s inequality can be used to 

derive a lower bound (see the table at the end of this section for an exact 

statement of the inequality). We have 


rif eras) ( [ Ghase :) 


1 
= (-e-*)|0 log (+ 1 +2?) 
0 


-1 
log(1 + V2) ~ 0.557. 


To obtain an upper bound, we can use Holder’s inequality with p = 
q = 2 (see the table at the end of this section for an exact statement of the 
inequality). We have 
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1 1 1 
I< [ettae [me 
0 o l+z 
e722 1 1 
Gear (ca 
2 0 0 
ee 
=a 7 = 0.583. 


Hence, we have found a fairly tight bound for J (that is, 0.556 < I < 0.584), 
without having to perform much computation. 


One Dimensional Inequalities — Named 


[1] Carleman’s inequality (see Iyanaga and Kawada [9], page 1422) 


ie XP (: is log f(t) at) dz < ef f(x) dx 


when f(x) > 0. 
[2] Cauchy-Schwartz—Bunyakowsky inequality (see Squire [19], page 21) 


( / “fla)o(2) ic) < ( / "P@) ar) ( / ‘P(2) ir). 


Equality occurs only when f(x) = kg(x), with k real. 
[3] Hardy’s inequality (see Iyanaga and Kawada [9], page 1422) 


oo P Pp oo 
I (FP) #s(&) [roe 
0 x l-p 6 
when p > 1 and f(x) > 0. Equality is achieved only if f(z) = 0. 
[4] Modified Hardy’s inequality (see Izumi and Izumi (8]) 


fe (z " at) as<(5F5) if ‘a |¢(2) - sa)” ae 


when m > 1, p> 1, and f(x) > 0. 


{5] Hardy—Littlewood supremum theorem (see Hardy, Littlewood, and Polya [7], 
page 298 (#398)) 


[ (2 = ef nat), dz < ( ca) [ f*(t) at 


if k > 1 and f(x) is non-negative and integrable. 


46. 


(6] 


[7] 


[8] 


[9] 


[10} 


[12] 


[12] 


[13] 


[14} 
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Hélder’s inequality (see Squire [19], page 21) 


b b 1/p b 1/q 
J, f(x)g(x) dx) < ( / Ie)? ae ( / a2) dr 


when p and q are positive and 1/p+1/q = 1. Equality occurs only when 
a|f(x)|? = Blg(xz)|?, where a and £ are positive constants. 


Backward Hélder’s inequality (see Brown and Shepp [1]) 


1/p 1/q 
sup | [f(z — y)g(y)] dy < ( / lf(z)|? 2) ( / lo(z)|* 3) 


when f and g have compact support, p and q are positive, and 1/p+1/q = 1. 
Backward Hélder’s inequality (see Brown and Shepp [1]) 


1/p l/q 
ae Pp gq 
i eup [f(z — y)g(y)] dx > ( / \f(x)| a) ( / |9(x)| 3) 


when f and g have compact support, p and q are positive, and 1/p+1/g = 1. 
Minkowski’s inequality (see Squire {19], page 21) 


b 1/p b 1/p b 1/p 
( / Ic) + oe)? dr) < ( i Is(a)P ae) ( i. a(2)P a) 


for p > 1. Equality occurs only when f(z) = kg(z), with & non-negative. 
Ostrowski inequality (see Gradshteyn and Ryzhik [6], page 1100) 


a f(a)g(2) da Af (a) de 


when f(z) is monotonic ae: and f(a)f(b) > 0. 


< (f(@)] max 


Tschebyscheff inequality (see Squire [19], page 22) 


[seroerere +, ([ sere) ( ['oree) 


when f(z) and g(x) are both increasing or both decreasing functions. 
Tschebyscheff inequality (see Squire [19], page 22) 


b 6 6 
/ f(a)g(x) de < -—— ( | f(a) ir) ( ua) 


when f(z) is an increasing function and g(x) is a decreasing function (or 
vice-versa). 


Wirtinger’s inequality (see Hardy, Littlewood, and Polya [7], page 185 (#4257)) 
x vw 
[Poas [rae 
0 0 


If f(0) = f(x) =0 and f’ is L’. Equality is obtained only if f(z) = Csinz. 
Generalized Wirtinger’s inequality (1 < k < 00), (see Tananika [20]) 


cee - </é (1—k)/k (k- oye C2 ( . 
(/ lal de gtt-F/k(R 4 9) Res [i I? at 
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{15] Young’s inequality (see Hardy, Littlewood, and Polya [7], page 111 (#156)) 


a b 
we | f(z) de + I f(a) de 
0 0 


when f(x) is continuous, strictly monotone increasing in z > 0, f(0) = 0, 
a > 0, and b > 0. Equality occurs only if b = f(a). 


One Dimensional Inequalities: 
Arbitrary Intervals — Unnamed 


[16] If p(x) > 0 and f p(x) dz = 1 (see Hardy, Littlewood, and Polya [7], page 
137 (#184)), then (unless f is a constant) 


( | p(z) log f(z) 9) < / p(x) f(a) de. 


[17] If 0 < r < 8, p(x) > 0, and f p(x) dz = 1 (see Hardy, Littlewood, and 
Polya [7], page 143 (#192)), then (unless f is a constant) 


l/r 1/s 
( [ arse ac) < ( | veene*e) ic) 


[18] If 0 < a < f(z) < A < o and 0 < b < g(r) < B < © (see Hardy, 
Littlewood, and Polya [7], page 166 (##230)), then 


( / f?(z) as) ( / #*(2) dr) < (; V4 + (| / f(x)g(z) is) 


[19] If a, 6, a, @ are positive and f(z) is an increasing positive function (see 
Hardy, Littlewood, and Polya [7], page 297 (#397)), then 


[rs (2) dot [O's e) ed rs Ex he 


+b 


[20] If 1 <r <p and f(z) and g(z) are positive functions in L? (see Potze and 
Urbach (21]), then 


exp (- / fig?” ir) — exp (- / fog ir) 
1/p 
< Crp (/ If - a?) dz 


where C;,,y > 0. 
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One Dimensional Inequalities: 
Finite Intervals — Unnamed 


(21] Ifa > 0,b >0, a #1, f(x) is non-negative and decreasing, and f(x) # C 
(see Hardy, Littlewood, and Polya [7], page 166 (#229)), then 


(fer) <[- (6th) ] (Lr) (7). 


[22] If f(x) has period 2z, Io" fac = = 0, f’ is L?, and f(x) # Asinz + Bcosz 
(see Hardy, Littlewood, and Polya [7], page 185 (#258)), then 


a P(x) de < ra (f'(a))? de. 


[23] If0 < f’ < 1,0 < g(x) < 2, and k > 1 (see Hardy, Littlewood, and Polya [7], 
page 298 (#400)), then 


' (f(z) — f(g(z))\" , . RFC) - FF) 
i. ( xz — g(x) ) dz < k-1 ; 


(24) If0 < f’ <1 and 0 < g(x) < x (see Hardy, Littlewood, and Polya [7], page 
298 (#400)), then 


f(a) ~ f(9(2)) 
8 FO)~ HSE) go < §(a) (1 - tog $0): 


One Dimensional Inequalities: 
Infinite Intervals — Unnamed 


[25] If m >1,n > —1, f is positive (see Hardy, Littlewood, and Polya [7], page 
165 (#226)), then 


[ere dz 
0 


Po oo (eke) (m-1)/m rove) f/m 
m(n m-1) pm ' m 
st ([ preva) (fireman) 


Equality occurs only when f = Bexp (-Crltn)/ (m=) ), where B > 0 and 
C>0. 


(26] Ifa > 0,6 >0,a 4b, and f is non-negative and decreasing (see Hardy, Lit- 
_jJC in (0,é) 
tlewood, and Polya [7], page 166 (#228)), then (unless f(z) = D. -An(E oo) 
with C > 0) 


(fre) sf tees) (ev) (ee), 
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[27] If f and f” are in L?[0, 00] (see Hardy, Littlewood, and Polya [7], page 187 
(#259)), then 


fers) 2 fs) fave) 
/ 2d < 2 ac) ( a *ar).. 
(/ (F'(2)) :) <a(/ P(e) de [oe (2)) 


Equality occurs only when f(x) = Ae~® 7/2 sin (Bz sin 5 — x) 


[28] If f and f” are in L?[0, co] (see Hardy, Littlewood, and Polya [7], page 188 
(#260)), then 


I * (2(a) ~ (f'(@))? + (f"(a))?) de 2 0. 
0 


Equality occurs only when f(x) = Ae~2*/? sin (Bz sin 5 — z) 


[29] If f and f” are in L?[—00, co] (see Hardy, Littlewood, and Polya [7], page 
193 (##261)), then (unless f(z) = 0) 


( / ey ic) < ( / _£@) ir) ( / _("@) ic) | 


(30) If p > 1 and f(z) > 0 (see Hardy, Littlewood, and Polya [7], page 240 
(#327)), then (unless f(z) = 0) 


[ef #<(a) [re 


[31] Ifp >1,0<a<1/p, and p < g < p/(1 — ap) (see Hardy, Littlewood, and 
Polya [7], page 298 (##402)), then 


oO 3 1 z _ q 00 a/p 
[Pe oerene (2 [sane-wan) sx ([rmac) 


This result is also true if a > 1/p, p > 1, and p < gq. In both cases 
K = K(p,q,a@) > 0. 


[32] Under some continuity Teauirements with a@ > 0 (see Mingarelli (10]) 


f [f(x)[?ee”" de < <s5f _lf@yte" dz. 
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Two Dimensional Inequalities 


[33] Ifp>1,qg>1,p'+q0>1A=2-p'-q',h<1-pl,k<1-q"' 
h+k>0,andh+k> 0 if p-'+q7! = 1 (see Hardy, Littlewood, and 
Polya [7], page 298 (#401)), then 


F(2)9(y) "i a Pe Me 
LL agcebas ease (rma) (Pre). 


Here K = K(p,q,h,k) > 0. 


(34] If f(x), g(z) and h(2) are non-negative, and f*(xz), g"(z) and h*(z) are the 
equi-measurable symmetrically decreasing functions (see Hardy, Littlewood, 
and Polya [7], page 279, (#379)), then 


i - ii _ SG@)atv)h(-2-¥) de dy < / - | : haa nae, 


[35] If p > 1, p' = p/(p-1), f>° fP(x) de < F and fg? ‘(t) dz < G (see 
Hardy, Littlewood, and Polya [7], page 226 (#316)), “then (unless f(z) = 0 
or g(r) = we 


* f(z)g(y) Ipc 
[- aay map Co 


Other Inequalities 


[36] If the function f,g,...,h are linearly independent functions (i.e., there do 
not exist constants A, B,...,C’, some not equal to zero, such that Af ++ Bg+ 
--+Ch = 0) (see Hardy, Littlewood, and Polya [7], page 134 (#4182)), then 


SP@)de  ff(z)g(e)dz ... f f(x)h(z) de 
> 0. 


fr(a)f(a)dz fr(zg(a)dz ... fh2(x)de 


Notes 

{1] In this section, when no further explanation is given, functions with upper 
case letters are assumed to be integrals of functions with lower case letters. 
For example, F(x) = fy f(z)dz and G(x) = f> g(x) dz. Also, all the 
integrals in this section are assumed to exist. 

[2] If f(x) is a real continuously differentiable function that satisfies the bound- 
edness constraints [" 2?|f(z)|? dz < oo and [™ |f’(z)|? dx < oo, then 
for x > 0 we have 


alfa)? <4 / ” eLFOP at / "LPC at. 
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This, in turn, can be used to derive the inequality 


/ ” \f(a)/? de < 24/ | ” elFOP at / LF (ED)? at. 


This last inequality is known as Heisenberg’s uncertainty principle in quan- 
tum mechanics. 
[3] Evans et al. [3] contains a complete analysis of the inequality 


( / {@l+@-nuwr} ic) 
< K(r) ( / lie)? ar] ( / IF"(x) — (2? — r) F(a)|? ic) | 


[4] Pachpatte [18] derives generalizations of the inequalities 


co 9 2p poo 
i 2 F?? (2) dr < (25 P i) / a~™ f??(z) dx 


[= a7 ™ FP (2) dz < (—e. —?_) [oe | #(2) —f ()|" (x) dz 


with suitable constraints on f, m, and p. (Here, F. is related to the integral 
of f.) 
[5] The inequality ff |f|? dx dy <a ~ ( | fld|zl)’ for functions f holomor- 
G 


phic in GUT is referenced in Gamelin and Khavinson [5]. 
[6] Gronwalls’ inequality states (see Gradshteyn and Ryzhik (6], page 1127): 


Theorem: Let the three piecewise continuous, nonnegative 
functions {u, v, w} be defined in the interval (0, a] and satisfy 
the inequality 


w(t) < u(t) + [ u(r)w(r) dr, 
0 


except at points of discontinuity of the functions. Then, 
except at these same points, 


w(t) < u(t) +/ u(r)v(r) exp (/ v(o) a) dr 
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[7] Opial [12] showed that a \f(z)| f(z) dz < th KC f'(z))? dz, with certain 
conditions on f. A comprehensive survey of Opial-type inequalities may be 
found in Mitrinovié [11]. Yang [22] proved the generalization 


Theorem: If f(s,t), fs, and fs: are continuous functions on 
[a, 6] x [c,d] and if f(a,t) = f(b,t) = f.(s,c) = fa(s,d) = 0 
fora <s<bandc<t<d, then 


b d 
Jf weatttatovatas 
6 d 
< Go aKe= a f i) |for(s,t)|? dt ds. 


Two other generalizations of Opial’s inequality are in Pachpatte [16]. 
One of these generalizations is (the other is similar): 


Theorem: Suppose the functions p, g are positive and con- 
tinuous on A = [a, X] x [c,Y]. Let f = f(s,t), fa, fot be 
continuous functions on A with f(a,t) = f.(s,c) = 0 for 
a<s<X andc<t</Y. Ifm and n are positive integers, 
with m+n> 1, then 


>, ¢ Y XxX Y 
i / pf! |feel” dtds < K(X,Y,m,n) / / q\fetl"*" dtds (46.1) 
a c a c 


where K(X,Y,m,n) is a finite constant that depends on the 
functions p and g. If m < 0,n > 0, and m+n > 1, then 
(46.1) holds with < replaced with >. 


[8] Assume that f(t) and $(¢) are nonnegative and measurable on R*, and that 
both a and b are in the range (0,00). Define ®(r) = {- o(t) dt, Fr(z) = 


Jo f(t) o(t) dt, Fu(z) = f° f(t)o(t) dt, and M = (p/|c — 1|)?. Then (see 
Copson [2]): 


b 
| FPO-“odz < al fP?d?-“ddz ifp>1,c>1 
0 0 
oo oo 
/ FPO-*ddz > uf fP?D?-°ddz if0<p<i,e>1 
a a 
and ®(z) — 0 as zt + ©0 
oo oo 
i FP O-ddz < uf fPDP-“ddr ifp>1,ce<1 
a a 
b b 
i FRO °pdz > uf f?O?-“ddz if0<p<l1,c<1l 
0 0 
b b (6) 
i: FPO-1 6dr < » | fPar-} (108 5 AY" bas ifp>1 


[ FP e- ‘ode > wf fPar-l (log ma) ¢dz ifO0<p<l. 


a 
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(9] The HELP (Hardy, Everitt, Littlewood, Polya) inequalities are of the form 
(see Evans and Everitt [4}) 


b ji 2 b Pe ig 3 
{ [ (P|s'| +alsr)} ck f wis? [ wlwmll 


where p, q, and w are real-valued functions on (a, b] (with —co < a < b < 00), 
and M[-] denotes the second order differential expression M[f] = —(pf')’ + 
qf. There are some technical conditions on p, q, and w. 
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47. Integration by Parts 


Applicable to A single integral. 


Yields 
An asymptotic expansion of the integral. 


Idea 
By using integration by parts an asymptotic expansion may sometimes 
be obtained. 


Procedure 
Repeatedly using the process of integration by parts (see page 161) 
often allows an asymptotic expansion to be obtained. The remainder term 
is needed to determine the error at any stage of the approximation. 
Several theorems are available that can be used to state an asymptotic 
expansion of an integral immediately, see the Notes. 


Example 1 
The exponential integral is defined by 


E(x) = i. ‘ — dt. (47.1) 


We make the identification (dv = e~*dt, u = ¢t71), and then use the 
integration by parts formula, f udv = uv| — f vdu, on (47.1) to obtain 


(47.2) 


Making the identification (du = e~*tdt, u = t~?) in (47.2), and using 
integration by parts again, results in 
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Integrating by parts a total of N times results in 
Ei (2) = Sy(z) + Rn(z) 


= ( xy | + ((-1y"0 i = sr tt) , ae 


n=0 


Integrating by parts infinitely many times results in e~* )7~, ee 
This series diverges for all values of x (since the absolute value of the 
ratio of successive terms in the sum is n/z, which increases as n increases), 
and so is not a good representation of E,(z). 

However, it is not hard to bound the remainder term Ry(xz). We have 


fo) e~* 
|Rn(z)| = mt f pri a 


[oe] e~* 
< N! / dt 
7 Nt 
e= 


= NI 
ght 


~ (V2aNe-" Nn) — 


—2£ N 
= on N—— (*) 
x \ex 


where we have used Stirling’s approximation for N!, which is asymptotically 
valid for large values of N. From this rough approximation, we conclude 
that, for some values of z, smaller values of N may give a smaller remainder 
than larger values of N. 


Example 2 
The complementary error function is defined by the integral erfc(x) = 
jz fai e~* dt. By repeated integration by parts, we can obtain the asymp- 
totic expansion 
erfo(2) ~ 2 pote 
Va [2c 42° 82° 
—z? [oe] 
1)(3)---(2k— 
deo Fy WG) 2k = 1) 
k=0 


Va - okt 1p2k+1 


Once again, this asymptotic series diverges for all values of z. However, for 
a fixed number of terms, the approximation becomes better as x increases. 
A numerical illustration of this asymptotic expansion is in Table 47. 
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Table 47. A numerical comparison of the complementary error function with 
the first term and first two terms in its asymptotic expansion. 


e* ad ee 
r/n vx lx 22° 
z=1 0.15730 0.41510 0.20755 


erfc(z) 


zr=2 0.00468 0.00517 0.00452 


z=3 0.0000221 0.0000232 0.0000219 


Notes 

[1] The approximation in (47.3) indicates a common trait of asymptotic se- 
quences: For fixed z, the approximation gets worse as N increases, for 
fixed N, the approximation gets better as z increases. 

([2] Note that, from a numerical point of view, the integral in (47.2) is more 
rapidly converging than the integral in (47.1). 

[3] Wong [4] presents the following example where integration | by parts does not 


dt 
lead to an asymptotic expansion. The integral I(x) = ————————_—_—— 
ped 7 pee) (1+t)(2 +t) 
can be integrated by parts to obtain 
N-1 fs 
ae (n—-1)! 1 
I(x) = X t3.Ge ps + 6n(z), (47.4) 


gY-*(N-1)! (P+) -* 
2-5:--@GN—4)f,  (@+t)* 
ing from (47.4) are not useful, since I(r) is positive but every term in (47.4) 
is negative. 
{4] Bleistein and Handelsman [2] have several general results about integration 
by parts. 
(A) Consider the integral I(A) = f h(t; A) f(t; A) dt. Assuming sufficient 
continuity, we have I(A\) = ee Sn(A) + Rn(A) (see Bleistein and 


n=0 
Handelsman [2], Theorem 3.1) where 


where 6n(z) = dt. Approximations aris- 


Sn(A) = (-1)" [0 AEP (b5 A) — F(a; AAEM (3 | 
Ry(A) = (-1)"* i FNM (E; AYACN—Y (4; d) dt 


where g‘") denotes the n-th derivative of g if n is positive, and it denotes 
the |n|-th integral of g if n is negative. If the functions {¢n(A)} form an 
asymptotic sequence as A — bo, and if [ac"-Y(e; A)| < an(t)da(A), 
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where the {a,} are continuous, then as 4 — Ao we have I(A) ~ 
bee Sn(A). As an example, if f is sufficiently differentiable, and 
if0 < a < b, then we have 


iar 


as A — oo. 
(B) Consider the integral I(A) = f h(At) f(t) dt. Assuming 
e sufficient continuity for f; 
® : — a is finite; 
A~*bn41(A) = 0(dn(A)) as A > 00; 
[h‘—”) (At)| < an(t)bn(A), where the {an} are continuous, 


then, as A — oo (see Bleistein and Handelsman [2], Theorem 3.2) 


I(d) ~ or cater) — Haya" BY] 


As an example, we have the result (if f is sufficiently smooth) 


b N 
Vi e'** F(t) dt ~ yo 


n=0 


Gi rag x [be i Faye] 


as A — oo. 


References 

[1] C.M. Bender and S. A. Orszag, Advanced Mathematical Methods for Scien- 
tists and Engineers, McGraw-Hill, New York, 1978 

[2] N. Bleistein and R. A. Handelsman, Asymptotic Expansions of Integrals, 
Dover Publications, Inc., New York, 1986, Chapter 3, pages 69-101. 

[3] <A. Erdélyi, Asymptotic Expansions, Dover Publications, Inc., New York, 
1956. 

[4] R. Wong, Asymptotic Approzimation of Integrals, Academic Press, New 
York, 1989, pages 14-19. 


48. Interval Analysis 


Applicable to Ordinary integrals, or integrals containing interval 
expressions. 


Yields 
An analytical approximation with an exact bound on the error. 
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Idea 

In interval analysis, quantities are defined by intervals with maximum 
and minimum values indicated by the endpoints. Definite integrals can 
often be approximated by an interval; intervals are better than ordinary 
numerical approximations since an exact bound on the error is obtained. 


Procedure 

We use the interval notation {a, b] to indicate some number between the 
values of a and b. We will allow coefficients of polynomials to be intervals. 
For example, the interval polynomial 


Q(z) = 14 (2, 3]z? + [-1, 4]z%, (48.1) 
evaluated at the point + = y, means that 
: 2 3 2 3 
min 1+ ny" +¢Cy" S$ Q(y) S max 1+ ny’ + Cy". (48.2) 
-i<¢<4 ~i<¢<a 


There exists an algebra of interval polynomials. For example 
(x + (2, 3]x) + ([1, 2]a + [1, 4]z*) = [2, 3]x + [3, 7]z%, 


({1, 3] + [—1, 2]z)? = [1,9] + [—6, 12]2 + [-2, 4]z?. 

If P(y) and Q(y) are interval polynomials, then at any point y we can 
write P(y) € [Pr, Pu], Q(y) € [Qz,Qu]. We say that P(z) contains Q(z) 
on some interval [c,d] if PL < Q1r,Qu < Py for all y € [c,d]. This is 
denoted by Q(z) C P(z). 

We now use capital letters to denote intervals; i.e., F(X) denotes the 
interval [F,, Fy] where Fy = minzex f(r) and Fy = maxzex f(z). If we 
define xe by 


t—1 bd 
Pei = lo+ ——(x—a),0+ ‘(e-a) ’ i= 1,2,...,7, (48.3) 


then, if f(z) is sufficiently smooth, 


[ ” f(t) dt C > F (x!”) (==*) (48.4) 


Define Q to the right-hand side of (48.4). The width of the interval Q, 
w(Q), can be shown to satisfy 


2 
w(Q) < K(z—- a)" 
n 
where K is a positive constant independent of n. 
The quadrature formula in (48.4) is essentially a first order integration 
formula for f f(¢)dt. Higher order formulae are also available. See, for 


example, Corliss and Rall (4]. 


(48.5) 
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Example 1 
This example illustrates the use of (48.4). Consider the integral J = 
fo sin rz? dz. Using (48.4) with n = 2, we have 


rc (F (0.31) $+ F (111) 4) (48.6) 


where F(X) = sin(7X?). The expression in (48.6) can be evaluated to 
yield 


fe (F ({0,sin? 2]) 3 + F ([0, sin? =]) :) 
= [0,3] 2 +1013 
= [0,3]. 
Example 2 


Consider the integral I = LP, f(z) dz, where f(x) = 1+ [1,2]z + 2?. 
It is straightforward to show that 


ee [l+2e+27,1+2+27] for-l<2z<0, 
| [lta+27,14+2¢+27] for0<2<1. 


Hence, we have 


0 1 0 1 
rf 14204074 [ 1+242%, | lteter | 1420 +2°| 
0 -1 0 


Notes 

([1] The techniques presented in this section can be evaluated numerically. In- 
terval arithmetic packages are available in Algol (see Guenther and Mar- 
quardt (5]), Pascal (see Wolff von Gudenberg [10]), and FORTRAN (see 
ACRITH [1], but see also Kahan and LeBlanc [6)). 

{2] Corliss and Rall [4] describe an interval analysis program that evaluates 
integrals by implementing Newton-Cotes rules, Gauss rules, and Taylor 
series. They also consider problems in which the limits of integration are 
intervals. 
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Applicable to Integrals of the form J(A) = [ be g(z)e*F@) dx, where f(z) 
is a real-valued function. 


Yields , 
An asymptotic approximation when A > 1. 


Idea 


For A — oo the value of I(A) is dominated by the contributions at 
those points where f(z) is a local maximum. 
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Procedure 
Given the integral I(A), consider the term e*f(*) for fixed A. This 
term will have a stationary point, (i-e., a local maximum or minimum) 
when de*S(*) /dz = 0, or f'(z) = 0. The behavior of J(A) is dominated at 
the local maximums of f; points where f'(z) = 0 and (usually) f”(z) < 0. 
If the stationary point 2; is an interior point (i.e., a < 2; < 6b) then 
I(X) may be approximated, in the neighborhood of this point, as 


zite 
I(A) ~ / ef (2) g(x) dx 
Dine 


~ ie exp f (sa) + Gente) +. | 


ime 


pe 2M z: 
x a(x) + (2 — 2;)g' (xi) + (en sihg ey) + e dz 


Key g(x; )erF @*) Zite (ex ered) ae si) dz 


~ g(aieer | [ (eol Gaal) 5. dz 
~ ale.\erfled |. f 2% 
gus f NF" al 


(49.1) 
which is valid as A — 00, when f”(2;) < 0. If f’(z;) > 0, then the point 
z; is a local minimum of f, not a local maximum, and this point does 
not contribute to leading order. (For the case f”(x;) = 0, see the Notes, 
below.) 

For each point where f has a local maximum there will be a term in 
the form of (49.1). To find the asymptotic approximation to I(A), these 
terms must be summed up. 

For the stationary boundary points (i.e., those stationary points that 
are on the boundary of the domain, either z; = a or 2; = b) there is a 
term in the form of (49.1), but with half the magnitude (if f”() is negative 
at that boundary point). This is because the integral in the fourth line of 
(49.1) becomes an integral from 0 to oo or —oo and not from —co to oo. 

If either of the boundary points is not a stationary point, (i.e., f’(a) 4 
0 or f’(b) 4 0), then these boundary points points contribute 


Af (a) Af(b) 
es on Ta} oe NE os 5 (49.2) 


to the sum forming the the asymptotic approximation of J(A). The contri- 
butions from non-stationary boundary points will always be asymptotically 
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smaller than the contribution from the points at which f is a local max- 
imum. Hence, if the region of integration contains any points at which f 
is a local maximum, and if only the leading order behavior is desired, then 
the non-stationary boundary points can be ignored. 


Example 1 

For the integral J(A) = ss e— © dy we identify f(z) = —cosz, 
g(x) = 1, a = 0 and b = 10. The stationary points are where f’(z) = 
sinz = 0, or s = {0,7,27,32,47,...}. We are only interested in those 
stationary points in the range of integration, that is s = 0, x = 7, x = 27, 
and x = 3m. Including the boundary points + = 0 and x = 10 we have 
four points that can potentially contribute to the leading order term in the 
asymptotic expansion. 


x =0 This is a stationary boundary point. However, since f’(0) = 1 > 
0, this point does not contribute to leading order. 

x= This is an interior stationary point. Since f’(7) = —1 < 0, this 
point contributes a term of the form in (49.1): 


= Af (x) oe an rE d 
In g(m)e d|f'(x)| 5 e€ 


x = 2n This is an interior stationary point. However, since f’(27) = 1 > 
0, this point does not contribute to leading order. 

x = 3n This is an interior stationary point that is a local maximum since 
f" (3x) = -—1 < 0. Hence, this point contributes a term of the 


37 21 
form in (49.1): Iz” = rea) saa =e. 
orm in (49.1): Is, = g(3a)e ED) x? 
x =10 This is a non-stationary boundary point. Hence, this point con- 


; _ g(10)e2F@) _ e008 10 
tributes (from (49.2)): Tio = xyf"(lb) Asin dO” 


We can combine all of the leading order contributions we have to find 


2m e7> cos 10 Sir e7> cos 10 
A) ~ IntTgn +li0 = 4/ — ee ns 
a PeNenteen0 V5 aes Cadac ig otaae eT 
However, since we have only kept the leading order term in the asymptotic 


expansion near each point, we can only keep the leading order term in the 
final answer (assuming no cancellation of terms has occurred). Our final 


result is therefore: 
JA) ~ fed as A— 00. 
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Example 2 

Consider the integral J(A) = IP e*?” dz, so that f(z) = x? and g(x) = 
1. In this case the stationary points are given by f’(x) = 2z = 0, orz = 0. 
The point z = 0 is a stationary boundary point, but it does not contribute 
to leading order since f’(0) = 2 > 0. The point x = 1 is a boundary point 
and the leading order asymptotic approximation is given by (49.2): 
g(1)eF) _ e* 


Example 3 

Consider the integral K(A) = Je e74e? dz, so that f(x) = —a? and 
g(x) = 1. In this case the stationary points are given by f’(x) = —2x = 0, 
or xz = 0. The point z = 0 is a stationary boundary point, and it contributes 
to leading order since f”(0) = —2 < 0. The leading order asymptotic 
approximation is given by (49.1) with a factor of 4 (since z = 0 is a 
boundary point): 


wd g(t, | ay = 35 x 
K(A) 59( Le MFO] ~ 2Vd as A oo. (49.3) 


For this integral, we recognize that K(A) = oz erf (v3), where erf is 


the error function. Use of the asymptotic expansion of the error function 
for large arguments also results in (49.3). 


Example 4 
An integral representation of the gamma function, for A > 0, is 


oo oO 
T(A) =i a te-*dz =| a tet er! egy, (49.4) 
0 0 


If X is an integer, then (A) = (A — 1)! (see page 163). 

From (49.4) we have f(x) = —logz, but f(z) has no finite stationary 
point about which to apply our above expansions. The change of variable 
x = Ay transforms (49.4) to 


T(A) = [ e(—y+log y) 2. (49.5) 
0 
Now f(y) = —y + logy and g(y) = y~!. The minimum of f(y) is at 


f'(y) = 0, or y = 1. The value y = 1 is an interior stationary point of 
(49.5), so we have (from (49.1)) 


mw a(t), | —2™ __ = yre-a, / 27 
T(A) ~ A*g(1)e*F" Wr@ > ° 2. (49.6) 


From (49.6), and a little manipulation, we obtain the leading term in 
Stirling’s approximation to the factorial: [(n + 1) = n! ~ V2ann"e~*. 
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Example 5 

Consider the integral I(A) = f>° eX? (@-Dlese dz, for A > 1. If we 
make the obvious identification, f(x) = z, then the region of maximum 
contribution will be around z = oo. To determine this contribution, some 
re-scaling of the problem is required. 

Looking at the whole integrand, the stationary point is given by 


a (gaa! ee) = 0, or A= z—-1 + log z. 

dz x 

As suggested above, the stationary point occurs at a large value of x. If 
z is large then, approximately, the stationary point is given by z = e*—!. 
Making the change of variable t = z/e*—1, we are led to consider 


I(A) = e201) ie te(e** )(t-tlogt) ge — e2A-)) 7 (2-1) 
0 


where J(¢) = J>° teS(-*!°8") dt. Since we want \ > 1, this corresponds to 


¢ > 1. Now it is a simple matter to show that J(C) ~ eS ,/27/C (since the 
only stationary point is at t = 1). Hence, we obtain our final answer: 


(A) © Vame®O-D/2e"" as, X00. 


Notes 

[1] Laplace’s method is an application of the method of steepest descents, see 
page 229. In the method of steepest descents, the function f(x) can be 
complex valued. In the method of stationary phase (page 226), the function 
f(z) is purely imaginary. 

(2) If more terms are kept in (49.1), then we obtain the approximation 


On 1 " le pi 5g (f’”") 2 
1a) ~ 4 |e zed (ere oe 2 EE ee 
( ) —yf p+3( Qf “ery?” 2(¢") 24 (f”)° + 


where all the functions are evaluated at z = z; (see Bender and Orszag [1], 
page 273). If the asymptotic expansion in Example 4 were continued to 
higher order, then we would find 


othe tao.) 
TA) ~ A“e X 1+ Tox + dean? ey 


This yields a better approximation to the factorial function than the one- 
term Stirling’s approximation. 

[3] _Watson’s lemma (page 197) applies to integrals of the form i. e*Y F(y) dy. 
By an appropriate change of variable, [(A) can be changed to this form. 
For example, we can use the transformation y = f(x) and then (assuming 
monotonicity) A = f(a), B = f(b), F(y) = 9(x)/f'(z). 
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[4] If the second derivative vanishes at an interior stationary point, so that the 
leading order behavior at a stationary points is given by 


la) = Flas) + EAB" pio(p,) 


for x near 2;, then the first term in the asymptotic approximation of J(A) 
becomes (assuming that n is even, and f‘")(x;) < 0, both of which are 
required for 2; to be a local maximum): 


1 
ar (=) (n!)'/" 

(A) ~ SG) Oe ai (49.7) 
n (Af™(z:)) 


[5] Multidimensional analogues of this technique are described on page 199. 

(6] Skinner at) considers uniform approximations for integrals of the form 
erh(t) J; e~**() o(¢)¢°—! dx as A > 00. 

[7] Temme [4] considers uniform approximations for integrals of the form 


(1/T(A)) fr? -1e-** f(t) dt as A — 00. 
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50. Stationary Phase 


Applicable to —_Integrals of the form I(A) = hs g(z)e*F(*) dr, where 
f(z) is a real-valued function. 


Yields 
An asymptotic approximation when A > 1. 


Idea 
For A — oo the value of J(A) is dominated by the contributions at 
those points where f(z) is a local minimum. 
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Procedure 
The Riemann—Lebesgue lemma states that Jim Rg h(t)e*** dt = 0, 
“OO 


provided that [ i |h(t)| dt exists. In simple terms, if the integrand is highly 
oscillatory, then the value of the integral is “small.” 
Now consider the integral 


I(A) = iE ef (2) 9(x) dex. (50.1) 


Through an appropriate change of variables, it can be shown (in non- 
degenerate cases) that I(A) — 0 as A — oo. The maximum contributions 
to (50.1) will come from regions where the integrand is less oscillatory. 
These regions are specified by the stationary points of the integrand, that 
is, where f'(xz) = 0. 

Let the stationary points in the interval [a,b] be {c;}. Following a 
derivation similar to that given for Laplace’s method (see page 221), we 
find that the leading order contribution to J(A), due to the stationary 
point c, is (assuming that f(c) #0, f’(c) #0, and g(c) # 0): 


Te~ 904] sry, em fare — sgn Fo) (50.2) 


where sgn denotes the signum (or sign) function. 

The leading order asymptotic behavior of I(A) is then given by }); Ic,- 
It is difficult to obtain a better approximation than just the leading order 
approximation, because it requires delicate estimation of integrals. If a 
higher order approximation is desired, then the method of steepest descents 
(see page 229) should be used. 


Example 
The Bessel function J,(x), for integral values of n, has the integral 
representation (see Abramowitz and Stegun [1], 9.1.22.b) 


Jn(A) = i; cos(nt — Asin t) dt 


Pa = » [ etint pFiA sin t dt. 
+ 40 


Each integral in the sum has the form of (50.1), with fz(t) = +sint and 
gz(t) = e+*"*, On the interval [0,7] the only stationary point for f+ is at 
t = 1/2. Hence, we find fz (%) = 1 and ff (=) = 1. Therefore, (50.2) 
can be evaluated to yield 


In(A) ~ = Lew(si) exp (+i [-a + =|) 


(50.3) 
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for A> 1. 


Notes 

{1] Determining the asymptotic behavior of an integral by plugging into the 
above formulas is a dangerous approach. A simple example where this naive 
approach could go wrong is with the integral J = [°° ei(3At?—3t°) Gt Use 
of the above formulas would result in a stationary point at ¢ = 0, which 
leads to the incorrect approximation fn /3A0**/ *. For this integral, there 
are stationary points at both ¢ = 0 and t = A. Using the contributions from 
both of these stationary points results in the approximation 


{2] If there are no stationary points in the interval of integration, then the 
leading order asymptotic behavior is determined by the contribution near 
the limits of integration. The leading order behavior, in this case, can be 
determined by integration by parts. 

[3] If the leading order expansion of f(t), near the critical point t = c, is given 


(n) 
by f(t) = f(e) + mT —c)" +..., then the leading order behavior of I 
is given by (assuming, again, that g(c) ¥ 0): 


aI(1/n) 


lj/n 
a n! ; _ it (n) 
I, ~ g(c) Gracy, exp lia f(e) 57 58 f (0)| . (50.4) 
Equation (50.2) is just this formula evaluated at n = 2. Note that if the 
stationary point is a boundary point, then the factor of 2 in (50.4) does not 
appear. 

As an example, consider the Bessel function at large order and large ar- 
gument. That is, consider the integral (see (50.3)) Jm(m) = x’ [> cos(mt- 
msin t) dt, for m > 1. Writing this as Jm(m) = (2r)~* 0, fo" etm @—sin 
dt, we identify f(t) = t —sint. For this integral, the only stationary point 
is at c= 0 (since f’(c) = 0). At this stationary point the second derivative 
vanishes: f’(0) = 0. Directly keeping terms of the next order results in 


Jm(m) = Re (2 | ging?) it 
® Jo 
re Re (2 i eint?/6 it) 
T Jo 


_ 1,-2/3,-1/6 -1/3 
= 223 (5) mo. 

This result could also have been obtained from using (50.4). We have 
g(t) = 1/7, f(t) = sint —t, f'(t) = cost —1, f(t) = —sint, and f’"(t) = 
— cost. Hence, we find that c = 0, n = 3, and |f’”(c)| = 1. Using (50.4) and 


50. 


[4] 


[5] 
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removing the factor of 2 since the stationary point is a limit of the integral 
we find 
1© (4) saty33 in 
eens (: > (G) e(-7) 


r(i 1\ 1/3 
FPS)" (-D 
nr 3 m 4 
1 

7 


9-2/33-1/6p (3) m3, 


Stationary phase is an application of the method of steepest descents, see 
page 229. In the method of steepest descents, the function f(z) can be 
complex valued. In Laplace’s method (page 221), the argument to the 
exponential is purely real. 

This method was first applied in Stokes [9]. A rigorous justification of the 
method is presented in Watson [10]. 
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51. Steepest Descent 


Applicable to _ Integrals of the form {, e*/()g(x) dz, as 4 tends to 
infinity, where C is a contour in the complex plane and f(x) and g(2) may 
be complex. 


Yields 
An asymptotic approximation when A > 1. 


Idea 

Given an integral in the form of f, e*/()g(z) dz deform the contour 
of integration so that it is in the form of a Laplace integral (see page 221) 
and apply the method described there. 


Procedure 

Some definitions are needed before the method can be described. Given 
the complex analytic function f(z), of the complex variable z (i.e., z = 
x+iy), let fp and f; denote the real and imaginary parts of that function 
(iie., f(z) = fr(z) + if7(z)). Given a point zp, a directed curve from zo 
along which fr(z) is decreasing is called a path of descent. The path of 
steepest descent is the curve whose tangent is given by -Vfr. This path 
is also one of the curves along which f;(z) is constant. That is, a curve of 
steepest descent is also a curve of constant phase. 

Suppose that f(z) and its first n — 1 derivatives vanish at z = zp: 


d'f 
dz? 
anf 


dz” 


=0, forg=1,2,...,n-1, 
ore (51.1) 


=ae™, witha>0O. 
z2=20 


That is, f(z) = f(zo) +f (z0)(z—z0)"/ni+.... If z = 29 +e, then the 
directions of constant phase (i.e., f; is constant), from the point z = 2p, 
are given by 


T Qa ; 


for p = 0,1,...,2 —1. Furthermore, fp decreases where cos(n6, + a) 
is positive, and increases where cos(n@, + a) is negative. Using a = 0 
for illustrative purposes, Figure 51.1 shows the regions of increasing and 
decreasing values of fp. (A nonzero value for a would just rotate the 
shaded regions in Figure 51.1.) 

The method of steepest descents can be succinctly described by the 
following steps: 
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- (a) 


/ 


Figure 51.1 For a = 0, the regions of increasing fr are shown clear, the regions 
of decreasing fr are shown shaded. The paths of steepest descent are shown 
dashed, the paths of steepest ascent are shown dotted for (a) n = 2 and (b) 
n= 3. 


[1] Identify the possible critical points of the integrand. These are the 
endpoints of integration, singular points of f(z) and g(z) and saddle 
points of f(z). (A saddle point is a point at which df /dz vanishes.) 

[2] Determine the paths of steepest descent from each of the critical points. 
A picture of the complex plane with curves drawn is usually very 
helpful. 

[3] Justify, via Cauchy’s theorem, the deformation of the original contour 
of integration C onto one or more of the steepest descent paths that 
were determined that connect the endpoints of integration. 

[4] The original integral is then equal to any contributions determined 
from the application of Cauchy’s theorem and an integral along every 
steepest descent contour that has been used. Each of these integrals 
has the appropriate form so that Laplace’s method may be used to 
determine the asymptotic value (see page 221). 


Special Case 

In the special case that n = 2, then we can formally proceed as follows. 
The function f(z) can be expanded about the point z = zo to find f(z) — 
f(z0) = $f'"(z0)(z — 20)? +.... If a = arg f"(zo) and z = 29 + ce, then 
this expansion can be written 


f(z) — f (20) 


e'%ee 
f"(z0)| (cos(a + a; + isin(a + 26)) + 


af "(z 0)| ta 229218 
3 \f 
2 


The steepest paths are given by sin(a + 20) = 0. The paths of steepest 
descent are given by cos(a + 20) < 0. For n = 2, the complex plane has 
the appearance shown in Figure 51.1.a. If the contour can be made to pass 
through the saddle point, via curves of steepest descent, then the integral 
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will have the form 


I(A) = | a(z)ev dz 


g(z)eF® dz — i g(z)e*F) dz. 


hi into saddle path out of saddle 


Let A represent a point from which the contour enters the saddle, and 
let B represent a point that the contour approaches after leaving the 


saddle. Then the last integral can be written as I() = Ii g(z)erf) dz — 
ij g(z)e*F() dz. Changing variables by —r = f(z) — f(zo), these integrals 
can be written as 
A A 
I(A) = ef (0) i e-*g(2(7)) = dr — ef (0) [ e-* g(2(r)) dr. 
0 dr 0 dr 
(51.3) 
The Laplace type integrals in (51.3) will be dominated by the contributions 


near 7 = 0, which corresponds to z = zp. Near this point we have r = 
—(f(z) — f(zo)) = -$f"(z0)(z — 20)? +.... Inverting this relation we find 


A 
+4/ eta/271/2 on he 
(z—z) = lf’ (zo)| o. 
=1] eta/271/2 on [. 
lf’ (z0)| 0 


This can be used to evaluate the dz/dr in (51.3). Substituting for this term, 
and extending both A and B to oo (to get the leading order approximation) 
results in 


I(A) ~ ef (0) : e~#2/29(z9) (2 ist dr+ ie = ar) 
If" (z0)| 0 27 0 2/7 


2 = @rf(z0)-ta/2 
aun) = 
N01 F(z) AW? 


(51.4) 
This result should be used with caution because of the many assumptions 
in its derivation. It is usually best to work out each problem from scratch, 
without resorting to formulas like (51.4). 
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Imz: 


e 
—2o 


Figure 51.2 The geometry of the complex plane for the integral in (51.5). 


Example 1 
Consider the integral 


[o.) 
I(A) = i) eMletiz—2°) gy (51.5) 
0 


as A — oo. The integration contour, C, consists of the positive real axis. 
Identifying f(z) = z+ iz — z%, we find that the saddle points are given 
by f! = 0 or z = 429 = £21/43-1/2¢'*/8 Near the point z = zp we can 
expand f(z) — f(zo) = $f""(zo)(z — 20)? +.... Using z = zo + ee”, this 
expansion can be written as 


f(z) — f(zo) = —21/43/2¢ [cos ( ns 26) a +isin G + 20) 


A path of constant phase has Im(f(z) — f(zo)) = 0, or sin (7/8 + 20) = 0. 
A path of descent (as opposed to a path of ascent) has Re(f(z) — f(zo)) 
decreasing, therefore cos (7/8 + 20) > 0. 

Figure 51.2 shows the original contour of integration (C), the two 
saddle points (+29), and the structure of the saddle around the point 
z = 2. The steepest descent contours Co and C, are also shown in 
Figure 51.2. The immediate problem is that the given integration contour C 
is not a steepest descent contour. However, using Cauchy’s theorem, we can 
deform the integration contour as long as we account for any singularities 
that we may cross. Because there are no singularities of the integrand in 
the region bounded by the contours, Cauchy’s theorem tells us that 


([+[,-[_)evrano 
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Therefore, if we can determine the integrals along the steepest decent 
contours then we can determine J(A). 
Changing variables by —r = f(z) — f(zo), we find 


1ay= [ewe az = [ ef (2) ae— [ ef (2) dz 
fo] i) 


= ef (20) (/ e7>T dz -[ e7*T iz) (51.6) 
co Co 
= erf (20) ( eT (F) dr - | eT (F) ar.) 
Co dr ee dr 


At this point we have reduced the problem to calculation of Laplace type 
integrals. Evaluating these integrals is straightforward. 

Near z = 29, which is where the dominant contribution of the integrals 
in (51.6) comes from, we have r = —3f"(zo)(z — zo)? +.... This relation 
can be inverted to find 


jee +6r/2 along Co, 
—Bri/2 along Coo, 


where § = 2~1/83-1/4e-*7/16_ Therefore, (51.6) becomes 


fore) -1/2 oo -1/2 
I(A) ~ dF) ( i; e—*" B-_ dr + / er Be ir) 
0 2 0 2 


= BerS (20) r (3) 


\/2 


7 /4q~3/2 351/8 
e2 3 e A 
ze Q71/83-1/4,-in/16 71/27 as A — 00. 
i/2 


Example 2 
Consider the integral representation of the Airy function 


foe) 3 3 
J(s) = Ai(s) = =/ cos (5 +st) dt = mai (sw - =) dw 
oo 


as s tends to positive infinity. The contour of integration is shown in 
Figure 51.3 (see page 3). Since this integral is not in the form we require, 
we change variables by z = w,/s and \ = s9/2 to obtain 


103256) = ae [ sp (, E = =|) > (51.7) 
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Figure 51.4 The geometry of the complex plane for the integral in (51.7). 


Note that the contour remains unchanged. We can now proceed with the 
steps described above. 

In this case, f(z) = z — z3/3 and g(z) = 1. Since both f(z) and 
g(z) are analytic, the only critical points are the saddle points of f(z) and, 
possibly, the endpoints of the contour of integration. The saddle points of 
f(z) are given by f’(z9) = 1— 22 =0, or zp = +1. 

Expanding f(z) into real and imaginary components results in 


f(z) =z—423 = fr(z) +if(z) = 2 (1-327 + y’) — iy (x? — 4y?-1). 
The curves of steepest ascent and descent at the points z9 = +1, satisfy 
fr(z) = frlz = £1) = file = £1,y = 0) = 0. 


That is, y (x? — 3y?—1) = 0. These curves are shown in Figure 51.4. 
We can now use (51.1) and (51.2) to determine exactly what the steepest 
descent paths are from the saddle points. Since f(z) = —2z we find that 
fl"'(z = —-1) = —2 = 2e*" and f"(z = 1) = 2 = 2e. Hence, az=; = 7 and 
Qz—--1 = 0. We conclude, therefore, that: 
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a 


Imt “? 


Ret 


Figure 51.5 The geometry of the complex plane for the integral in (51.8). 


[1] The directions of steepest descent from z = —1 lie along the hyperbolas 
a? — iy” = 1 (these are labeled C, and C2 in Figure 51.4). 

{2] The aieecuinns of steepest descent from z = 1 lie along the line y = 0 
(these are labeled C3 and C4 in Figure 51.4). 


Now that we have identified the curves of steepest descent, we would 
like to move our given contour to one or more of these steepest descent 
contours (justified, of course, by Cauchy’s theorem). Since the integrand 
is analytic (it has no poles or branch cuts) the original contour C can be 
deformed into the new contour to obtain C = —C, —C4+Cg3 (the plus 
and minus signs are needed since the contours shown in Figure 51.4 are 
oriented). We conclude that 


we C[-L+Lebb-Z)e 


These integrals are easily evaluated by Laplace’s method. We find (see 
Bleistein and Handelsman [3], page 267 for details) 


(a) ~—( M2 e-ans) — [2° avis) 4 (XE avs 
4/n didn didn 


Ave 22/3 
idan 


as A — 00. 


~ 


—1/4 
This leads to Ai(s) ~ a */3) as 8 + 00. 
R 


Example 3 

Consider the integral for the reciprocal of the Gamma function (see 
Copson [5]) : 

1 t—At 
(A) = Ta) - oni J e’—* dt, (51.8) 

where A may be real or complex, the principal value of the logarithm is 
taken, and the contour C is shown in Figure 51.5. (The contour C starts at 
—oo, circles the origin once in the positive sense, and returns to —0o.) We 
are interested in (51.8) as \ — oo. Changing variables by t = Az results in 
the representation 
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T(\) = X(z—log z) dz. 
A= = 7 fe ms 


From this expression we have g(z) = and f(z) = z—logz. The only 
stationary point is at f’(zo) = 0 or z = 0. At the stationary point we 
find f(zo) = 1. A simple computation shows that the paths of steepest 
descent are as indicated in Figure 51.5. 

The contour C in Figure 51.5 can be trivially moved to go through the 
stationary point. Hence, the asymptotic behavior of [(A) is determined 
by the two paths of steepest descent indicated in Figure 51.5. Using the 
substitution z = 1+ is, and then the expansion log(1 + x) = x — 5a? + 


323 —..., we find 
1 a oe B aes 
I(A) ~ 9 | -7 i, e~ Mlog(1+is)—i8) gg 4 5 | eMlog(1+is)—is) G7, 
2rir A 0 


0 1 B 1 

= 4 (- i e287 t--) dg 4 / e387 +---) | 
A 0 
0 fore) 

=e [Lorre ra 
—-0co 0 

4 (=) x 

r Qn 


If the above Laplace type integrals were expanded to higher order, 
then we would obtain the expansion 


ee ey" A ( 1 1 139 


ay ay eae ae ee ee RT 
a =(5 On 12\ * 288X2 518403 ) ot) 


Example 4 

Consider the integral J(A) = So log ze*** dz, for \ >> 1. For this 
integrand, the half-plane with Im z > 0 is a region of descent. The steepest 
descent contours are the lines with Rez equal to a constant. In this case 
the integration contour C is deformed into the 3 contours C,, C2, and C3 (see 
Figure 51.6). By Cauchy’s theorem we have I(A) = J, = fo, + So, + Seq» 
where the integrand is the same for each integral. In the limit of the 
rectangle extending vertically to infinity, we find that I(A) = [5° + h. oo 
The first of these integrals can be evaluated exactly 


$00 : lo) 
i log ze? dz =i / log(is)e~>* ds 
0 i) 


jlosA iy + 71/2 


x A 


(51.10) 
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Figure 51.6 Integration contour and steepest descent contours for i log ze**? dz. 


where 7¥ is Buler’s constant. 
The second integral in the above can be evaluated by Watson’s lemma. 
Using log(1 + is) = — S-°°.,(—is)"/n, we find 


1 los) 

i log ze? dz = -i 4 log(1 + is)e*(+#) ds 
me eet (51.11) 
~ ie > ee as A — 00. 
n=1 
Combining the results in (51.10) and (51.11) results in an asymptotic 
expansion of J(A). Full details may be found in Bender and Orszag [1], 

pages 281-282. 


Program 51 


s: if mod(capN,2)=0 
then 1 
else ( if tpos then 1 else -1) $ 


wp[k]:= block([temp], 
if k=0 


then w(x) 
else (temp:wp[k-1], ratsimp(diff (temp,x))))$ 


phip[k]:= block([temp], 
if 


then phi(x) 
else (temp:phip[k-1], ratsimp(diff(temp,x))))$ 


wpz[k] :=block([temp], temp:wp[k], ev(temp,x=z0) )$ 
phipz[{k] :=block([temp], temp:phip[k], ev(temp,x=z0) )$ 


alpha[n):= (wpz[capN+n]/(capN+n)!) / (wpz[capN]/capN!) $ 


51. 
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term(m,k,capN,kp) :=((m-k-kp)*(m+1)/capN+kp) * 
(m-kp) ! /k!*alpha[m-k-kp] *D[m,m-kp]$ 

D({m,k):= block( [kp], 

if mek 

then gamma( (m+t1)/capN )/(capNen!) 

else factor( -1/(m-k)*sum( term(m,k,capN,kp), kp,0,m-k-1) ))$ 
hold:-s*wpz[capN] *name/capN!$ 
specialsum3 (mp) :*sum( D([2*mp,k]*phipz[k], k, 0, 2*mp)$ 


%e**(name*w(z0)) * sum( 2* hold**(-(2*mp+t1)/capN) * specialsum3(mp), 
mp,0,numberofterms) ; 


Notes 


[1] 
[2] 


[3] 


[4] 


This is also called the saddle point method. 

Bleistein and Handelsman [3] treat the more general problem 

I(A) = f. g(z)H(Aw(z)) dz where g(x) and w(z) are analytic in the region 
containing the contour C, and A — oo. Here H(z) is an entire transcendental 
function, such as sin z, cos z, or Ai(z). 

In many specific cases, it is often impractical to construct paths of steepest 
descent. In some problems it may be easier to use Perron’s method (see 
Perron [6]), which avoids the explicit construction of steepest descent paths. 
See Wong [7] for details. 

Campbell, Fréman, and Walles [4] give explicit series for the asymptotic 
approximation of f e~ (2) 6(z) dz as A — oo for a well isolated singular 
point zo. A computer program written in REDUCE is also given. 

If w)(z9) = 0 for j = 1,2,...,N —1 and w'*)(z9) # 0 then the only 
inputs required for the program are w(z) and ¢(z) (and their derivatives), 
N, zo, the number of terms desired in the expansion, and the sign of the 
parameter in the reparametrization of w(z) near the singular point. That 
is, near zo) we write w(z) = w(zo) — st” where 


+1 when N is odd and t > 0, 


+1 when N is even, 
s= 
-—1 when AN is odd andt < 0. 


The author has re-written the program in Macsyma; it is shown in 
Program 51. As an illustration of the Macsyma program, consider the 
calculation in Example 3 (with A replace by —v). If the following program 
segment is placed before the code shown in Program 51: 

capN :2$ 

20:13 
numberofterms :3$ 
tpos:false$ 

w(x) :=x-log(x)$ 
phi(x) :=1$ 

name :nu$ 


then the following output is obtained: 
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sqrt(2) sqrt (%pi) et (2) sqrt (%pi) , oat (2) sqrt (%pi) 


sqrt(- nu) 3/2 5/2 
12 (- nu) 288 (- nu) 
139 sqrt(2) sqrt(%pi) nu 
crore eer enn eennnanace ) he 
7/2 
51840 (- nu) 


This result must be multiplied by ae to obtain the answer in (51.9). 
Rt 
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52. Approximations: Miscellaneous 


Idea 
This section contains some miscellaneous integral approximation tech- 
niques. 


Procedure 
Consider the integral I(s) = J>° e~**f(t)g(t) dt. If f(t) is analytic, 
then it can be expanded in a Taylor series. Hence, J can be re-written as 


(n) 
I(s) = ye f () ef e~*tg(t)t" dt 


n=0 


(n) 
=~ fF O -1)° S413) 


n=0 


(52.1) 


where 9(s) = Ss” e~5tg(t) dt is the Laplace transform of g(t). 
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Table 52. Some infinite series expansions for integrals of the form [, ie f(t)g(t) dt. 


f e~* F(t) dt = 3 fi mt 
0 


n=0 
/ sin at f(t) dt = we 1)" cow 
0 n=0 
7 cos at f(t) dt = we 1)" ante) 
0 n=0 
sin sin otf (0) n £°"-Y(0) 
[ dt = sf (0) - Yt 1) (Qn —1a” 


Setting s = 0 in (52.1) allows an infinite series expansion for J(0) = 
fo. f(t)g(t) dt to be obtained. Each choice of g(é) results in a different 
expansion, some are given in Table 52. These results are only formally 
correct; in practice, the resulting expressions may be asymptotically valid. 


Example 
Using the fourth expansion in Table 52, with f(t) = sint, we readily 
determine that 


oo e ° t 
J =/ sin mt sin dt 
0 


1 
t - dX (2n + 1)m™” O22) 


A table of integrals shows that J = 5 log (=**), when m > 1. If this 


result is expanded around m = oo, re the result in (52.2) is obtained. 


Note 
(1] This technique is from Squire [1], who credits Willis [2]. 
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Vv 


Numerical Methods: 
Concepts 


53. Introduction to 
Numerical Methods 


The last sections of this book are concerned with numerical meth- 
ods for approximating definite integrals. Section V defines some of the 
terms used in numerical methods, describes different software libraries, 
and displays integrals that have appeared in the literature as test cases 
for numerical routines. Section VI describes a selection. of many possible 
numerical techniques. 

Note that a definite integral, say I = f f(x) dz, can be interpreted as 
the solution of a differential equation. In this interpretation, J = y(b) where 
y’ = f(x) and y(a) = 0. Hence, any numerical integration technique for 
differential equations can be adapted to numerically evaluate an integral. 
(See Zwillinger [4] for some numerical techniques for differential equations.) 
In fact, for an integrand that has.an integrable singularity, at an unknown 
location in the integrand, it is probably preferable to use a differential 
equation technique. 

One of the most comprehensive books on numerical integration tech- 
niques is Davis and Rabinowitz [1]. It contains a comprehensive bibliog- 
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raphy, up to 1984. The book by Stroud [2] contains extensive tables of 
numerical methods. 

The most popular computer library that the author is aware of is 
Quadpack (see Piessens at al. [3]). This library implements quadrature 
rules with the following desirable features: 

e All nodes are within the integration interval (sometimes the nodes 
include the end-points). 
e All weights are positive. 
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54. Numerical Definitions 


Adaptive Quadrature For the integral J = [ f(z) dz, traditional 


quadrature rules use estimates of the form I ~ I = )“"_, wif (2;) for some 
specific choice of the weights {w;} and nodes {z;}. An adaptive quadrature 
technique uses an algorithm to choose the weights {w;} and nodes {z;} 
during the computation. Thus, an adaptive algorithm dynamically adapts 
the integration rule to the particular properties of the integrand. 


Automatic Quadrature Routine This is a piece of software, designed 
to provide an approximation of specified tolerance to a given definite inte- 


gral. 


Closed Rule Consider an approximation to the integral J = is f(x) de. 
A quadrature rule that uses the values of f(a) and f(b) in the numerical 
approximation of J is called a closed rule or a closed formula. 


Composite Rule If a numerical quadrature rule for integrating over a 
small parallelpiped region is repeatedly applied to find a rule applicable 
over a larger parallelpiped region, the new rule is called a compound or 
composite rule. See page 282. 


Fully Symmetric’ A region B is said to be fully symmetric if x = 
(21,22,...,%4) € B implies that (42,1), +2p(2),---, £Zp(a)) € B, where 
the set {p(1), p(2),...,p(d)} is any permutation of {1,2,...,d}. 
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General Purpose Integrators A numerical quadrature rule is said to 
be general purpose if the routine works for generic integrands. If a routine 
requires that the integrand have the form w(x) f(x), for some special weight 
function w(x), then the routine is called special purpose. 


Nodes In the quadrature rule qe f(z)dz = >, wi f(zi), the distinct 
numbers {z;} are called the nodes (also called abscissas, or points). 


Null Rule The numerical quadrature rule [ f(z) dz = }°, wif (xi) is 
said to be a null rule if 5°; w; = 0 and at least one of the {w;} values is 
non-zero. Furthermore, a null rule is said to have degree d if it integrates 
to zero all polynomials of degree less than or equal to d and fails to do so 
for f(z) = 24*?, 


Numerically Stable A numerical quadrature rule is said to be numer- 
ically stable if all of the weights are positive. 


Open Rule Consider an approximation to the integral J = i f(x) dz. 
A quadrature rule that does not use the values f(a) or f(b) in the numerical 
approximation of J is called an open rule or an open formula. This would 
be needed, for instance, if a = 0 and f(x) = 2~1/?. In this case, J has an 
integrable singularity, but f(0) is infinite and should not be computed by 
a quadrature routine. 


Order Given a quadrature rule of the form 


b N 
[ fede = So an flan) + Ey] 
2 n=1 


there exists a largest integer k such that E[p] vanishes for every polynomial 
p of degree less than k. The number k is usually called the order and k —1 
is called the degree of precision of the rule. We have the bound k < 2N, 
where equality only holds for the Gauss—Legendre rule. 


Panel Rules Given an integral to evaluate J = ii f(x) dz, the interval 
of integration [a, 6] can be sub-divided into m equal length intervals, called 
panels. (The number m is called the mesh ratio.) Then one integration 
rule can be used on each panel, and the resulting approximation to I is 
called an m-panel rule. See also “composite rules,” page 282. 


Positive Quadrature Rule The quadrature rule i f(x) dz = wi 
f(2;) is called a positive quadrature rule if all of the weights are positive, 
w; > 0. 


Weights In the quadrature rule fc f(x) dz = ¥°; wif (xi), the numbers 
{w;} are called the weights. 


246 V Numerical Methods: Concepts 


55. Error Analysis 


Applicable to Integration rules of the form 


b 
[ tea 
a 
mo my, Mr 
~ P[f]:= SS anof (to) + >> anf’ (Tei) +e0°+ > ain f (kn) 
k=0 k=0 k=0 
Yields 
An estimate of the error in using P[f] to approximate [ . f(x) da. 
Idea 


An exact formulation of the error can sometimes be obtained. 


Procedure ; 
Define the error made when using P[f] to approximate f, f(z) dx to 
be 


b 
Eff] = PIf]- [ f(a) de. (55.1) 


A theorem by Peano states: 


Theorem (Peano): Suppose that E[f] = 0 for all polyno- 
mials f with degree no greater than n (i.e., polynomials of 
low degree are integrated exactly). Then, for all functions 
f € C"*?[a, 6] the error can be represented as 


b 
Elf] = / fT) (a) K(t) dt (55.2) 
where K(t) is the Peano kernel of EF and is defined by 


K(t) = =Blg(a:t)), 


n —t)” ifg> 
senntenn a {G- Erzh 


(55.3) 


Note that ¢ is just a parameter in the g function and that E operates only 
with respect to the x variable. (When evaluating the E function in (55.3), 
the representation in (55.1) should be used.) 

This theorem can be used to determine the error in integration rules 
explicitly. For many integration rules, the Peano kernel has a constant sign 
on [a,b]. Using the mean value theorem (see page 83) on (55.2) then allows 
the error to be written as 


Elf] = fe) / K(t) dt, (55.4) 
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for some & € [a,b]. Hence, by determining i K(t) dt, a simple, exact 
representation of the error is obtained. 

There is an easy way to determine the integral of K(t). Since (55.4) 
is presumed to be valid for all f € C"*1[a,b] we can use f(x) = x"*! in 


(55.4) to obtain E[z"*1] = (n+ 1)! iM K(t) dt so that 


nt+1 
= —— fint(¢) (55.5) 


for some € € [a, }]. 


Example 
Consider using the Peano theorem to find the error in Simpson’s rule. 
In Simpson’s rule we have the approximation 


1 
i F(x) de = 3 F(-1) + $f(0) + 34) 
and hence, 


1 
Elf] = [14(-1) + 44(0) + 4F@)] - / S(a)de. 


For this integration rule, all polynomials of degree less than or equal to 
three are integrated exactly. Therefore, we can apply the theorem with 
n = 3. The Peano kernel becomes 


K(t) = §Elg(z; t)] 
= 1Bi(2 - 93) 


1 
a {a1 ~ 934 40-93 4301-03] - / (a-1h az} | 
When ¢ is in the range [—1, 1] this expression can be simplified to yield 


1 
KW) =3{ 1-0 + 4-9$ + 40-05] - [ e-9%ae! 
t 
= § {[3(-#)3 + 30-89] - 301 -#)*}. 
The term (—t)3. depends on whether or not ¢ > 0. Specifically, 


ya _f0  ift>0 
(#3 = { 8 ift<0. 


Using this in the formula for A(t) we finally arrive at 


_Jfa(l-th(1+3t) if O<t<1 
HY) {BC t) if-1<t<0. 
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With Peano’s kernel explicitly determined, we observe that it has a 


constant sign (that is, positive) on the interval [—1,1]. Hence, by carrying 
out the integration in (55.4) we find 


1 
BUA) = F(@) 7 K(t) dt 
-1 
= wf (é) 


for some € in the range [—1,1]. We could also have obtained the factor of 
a5, using (55.5): 


1 1 4 4n4 144 : 4 
= — [| |5(-1)* + 30° + §1°} - x* dz 
4! 24 [3 3 3 ] a 


Notes 

[1] The usual way of estimating the error using a quadrature routine is to use 
two different rules, say A and B, and then estimate the error by |A — B|, or 
some scaling of this. In the case of adaptive quadrature (see page 277), the 
subdivision process provides additional information that can be used. See, 
for example, Espelid and Sorevik [3]. 

{2] Interval analysis is a technique in which an interval which contains the 
numerical value of an integral is obtained, see page 218. 

(3] For most automatic quadrature routines, an absolute error €, and a relative 
error €, are input. For the integral J = i: f(z) dz, the routine will compute 
a sequence of values {Rn,,En,}. Here, Rn, is an estimate of J using nz 
values of the integrand, and Ep, is the associated error estimate. The 
routine will terminate (and return a value), when the error criteria 


|Rn, ae I <S En, S$ max(€a, €r|Rn, |) 


is achieved. 

[4] Piessens at al. [10], Section 2.2.4.1, has a summary of the asymptotic ex- 
pansion of integration errors. Piessens at al. [10] (page 40) also has the 
(pessimistic) error bound: 


Let |f%*Y(2)| < Mr41 for a < x < b. Then the absolute 
error of the positive quadrature rule of precision d > k satis- 
fies: 


|E| = k+1 d®& d—k 


[ f(z) dz - > wif (as) < 2etar*t (b= a)**? Meta 


55. 


[5] 


[6} 
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Some integration rules have errors that can be represented as sums of terms 
with each term involving derivatives of the integrand at an endpoint of 
integration. For example, the composite trapezoidal rule has this property 
(see page 342). 

Given an integrand, suppose that a transformation can be found such 
that the derivatives of the new integrand vanish at the endpoints. Then, 
using this transformation with a rule of the above type should result in small 
errors. See Davis and Rabinowitz [2] for details. 

Some quadrature rules have the error decreasing exponentially with the 
number of nodes. For example, the “tanh rule” of Schwartz is given by 


[inersenn ye to (o*) 


for some c > 0, where h = h(N) is given by a certain formula (and h ~ 
cN-1/?), See Kahaner et al. [6]. 
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56. Romberg Integration / 
Richardson Extrapolation 


Applicable to Numerical techniques for integrals. 


Yields 
A procedure for increasing the accuracy. 


Procedure 

Suppose that a grid with a characteristic spacing of h is used to 
approximate the integral J = [ i f(x) dz numerically. Then the numerical 
approximation to the integral, J(h), can be represented by 


I(h) =I + Rmh™ + O(h™*?), (56.1) 


where m is the order of the method, and the other terms represent the 
error (see page 245). For example, the trapezoidal rule has the parameters 
m=3 and R3 = $f"(¢), witha<¢ <b. 

If the numerical integration scheme is kept the same, but the charac- 
teristic width of the grid is changed from h to k, then 


I(k) = I+ Rmk™ + O(k™*?), (56.2) 
Equations (56.1) and (56.2) can be combined to yield the approximation 


k™I(h) — h™I(k) 


I(h, k) = — a — ma 


=I +O(kh™, hk™). (56.3) 


Note that J(h,k) is one more order accurate than either J(h) or I(k). This 
process, known as Richardson extrapolation, may be repeated as often as 
is desired. If we write k = rh, then (56.3) may be written in the alternative 


eee Ce oe ee eel 


1-—r™ 
that if r is close to one, there may be roundoff problems. 
When Richardson extrapolation is used with the composite trapezoidal 
rule, and the number of nodes (nearly) doubles with each iteration (i.e., 
res 4), then we obtain the Romberg integration technique. For the integral 


+.... In this formulation it is clear 


I= f : f(x) dz, the m-th approximation is given by using 2” + 1 nodes: 


b-a 


1 1 
1% lom = Fm fot Sat ot fanaa + 5 fom], 
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Table 56.1. Results of using Romberg integration on (56.5). 


nodes Lo,m lim Tom I3m Iam Is,m 
3 0.905330 
5 0.964924 0.984789 


9 0.987195 0.994619 0.997895 

17 0.995372 0.998097 0.999257 0.999710 

33 0.998338 0.999327 0.999737 0.999897 0.999960 

65 0.999406 0.999762 0.999907 0.999964 0.999986 0.999994 


where f; = f(z,;) and 2; =a+ sm (b —a). The error in this approximation 
is given by (see page 342) 


enor = (28-1) (6) — gt) (a) 
ar (2% : rh | (56.4) 
+ (b= a) AP? AEE g(2H420(n 


where the {B;} are the Bernoulli numbers and a < 7 < b. 

Note that only even powers of h appear in the error formula (56.4). 
Because of this, each extrapolation step increases the accuracy by two 
orders. The extrapolated values of the integral are then given by 


1\2¢ 
Tx-1ym-1 — (§)° Ti-1,m-1 
ge cee UE 


| 1- (3)" 


It should be noted that the values {J; m} are identical to the values obtained 
from using the composite Simpson’s rule. 


fore 12st 


Example 
Given the integral 


z ah Vidz =1 (56.5) 


we might choose to approximate the value by using Romberg integration. 
Table 56.1 has the result of using Romberg integration on this integral. 

Note that the initial data has (at best) about 11 bits of precision (that 
is, — log, 0.000594), yet the fully extrapolated result has more than 17 bits 
of precision (that is, — log, 0.000006). 
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Table 56.2. Results of using Richardson extrapolation on (56.5). 


nodes R® RY Re R® RY R®) 


3 0.90533 

5 0.96492 1.02452 

7 0.98052 0.99611 0.98664 

9 0.98720 0.99387 0.99312 0.99355 

11 0.99076 0.99433 0.99449 0.99440 0.99436 

13 0.99293 0.99510 0.99536 0.99521 0.99515 0.99512 
15 0.99437 0.99580 0.99603 0.99590 0.99585 0.99582 
17 0.99537 0.99638 0.99657 0.99646 0.99642 0.99640 


Notes 


(1] 
[2] 


[3] 


[4] 


[5] 


This method also works for non-uniform grids if every interval is subdivided. 
While Romberg is intrinsically a recursive computation, it is possible to 
write explicit formulas for the successive approximations. See Davis and 
Rabinowitz [3] for details. 

A benefit of doubling the number of nodes at each iteration of Romberg 
integration is that the integrand values at the old nodes can be re-used. 
Press et al. [6] present a modification of Romberg integration where the 
number of nodes must be tripled before the values at the old nodes can 
be re-used. (This is because the integration rule they use for Ya f(x) dz 


depends on the values fn+1/2, where m is an integer.) 

A liability of doubling the number of nodes at each iteration of Romberg 
integration is that the number of nodes increases exponentially. Hence, 
some modifications of Romberg integration use a different sequence of node 
numbers. The sequences of node numbers {1, 2, 3, 6, 9, 18, 27, 54,...}, 
{1, 2, 3, 4, 6, 8, 12,...}, and {1, 2, 3, 4, 5,...} are discussed in Davis and 
Rabinowitz [3] and Fairweather and Keast [4]. Richardson extrapolation 
was used on problem (56.5) with the sequence of nodes {3,5,7,9,...}; the 
numerical results are in Table 56.2. 

In some cases, the order of the method, and hence the value of m in (56.1), 
will be unknown. Richardson extrapolation method may still be used by first 
estimating the value of m numerically, or the Aitken A? transformation may 
be used. The Aitken A? transformation uses three successive terms of the 
form Sp = Soo + ah” to estimate So. via 


Cae _ Sn415n-1 = Cae 


=. 56.6 
Sn41 + Sn-1 = 2Sn ( ) 


This transformation may be repeatedly applied; see Bender and Orszag [1] 
for details. If 2n +1 terms are used, not just three, then this transformation 
is known as the Shanks transformation. 

Table 56.3 has the results of applying the Aitken transformation to the 
integral in (56.5), when the trapezoidal rule has been used with n nodes 
(with n = 3,5,7,...). The superscripts refer to the number of times the 
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Table 56.3. Results of using the Aitken transformation on (56.5). 


nodes 5) gs) s®) s® 


3 0.90533 

5 0.96492 0.98604 

7 0.98052 0.99220 0.99690 

9 0.98720 0.99486 0.99795 0.99919 
11 0.99076 0.99629 0.99851 
13. 0.99293 =: 0.99716 
15 0.99437 


[6] 


[7] 


(8) 


Aitken transformation has been applied; the initial quadrature result has a 
superscript of zero. 

Bulirsch and Stoer [2] have a modification of this method. They compute 
trapezoidal sums for several values of A, fit a rational function of h? to this 
data (a Padé approximant), and then extrapolate to h = 0. On a practical 
level, nonlinear transformations such as those using Padé approximants are 
much more useful that Romberg integration. See also Press et al. (6). 

Note that the term Rm appearing in both (56.1) and (56.2) might con- 
ceivably not represent the same quantity. However, when an explicit error 
formula is available, such as the one in (56.4), then it is seen that the error 
terms are completely specified at every order. 

Richardson extrapolation is sometimes called deferred approach to the limit. 
In more detail, Richardson extrapolation proceeds as follows. If J is any 
function of h which can be represented as 


T= I(h) + >> ash! + em(h)h™ 


t=k 


and the {c;} are known, then we may define 6; = a;(r* — r*)/(1 — r*) and 
dm(h) = (em(rh)r™*! — em(h)r*)/(1 — r*). This results in 


jell eae) 


l-r 


+ So bih' + dm(hyh™t?. 
i=k+1 
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57. Software Libraries: 
Introduction 


When approximating the value of an integral numerically, it is best 
to use software prepared by experts whenever possible. Many commercial 
computer libraries and isolated computer routines for evaluating integrals 
are readily available. 

No endorsement of the software referenced in this book is intended, nor 
does it necessarily imply that unnamed integrators are not worth trying. 
However, if you are using a integrator on anything bigger than a pocket 
calculator, you should consider using one of the cited packages. In the 
literature there now appears to be commercially available “software” for 
integration with no error control, a user-specified step size, and no warning 
messages. We strongly advise against using such programs, even on a 
personal computer. For all but trivial integrals, such programs cannot be 
sufficiently reliable for accurate computational results. 

A taxonomy and description of mathematical and statistical routines in 
use at the National Institute of Standards and Technology (NIST) has been 
constructed, see Boisvert et al. [1] and [2]. The NIST guide, called GAMS 
(for Guide to Available Mathematical Software), was assembled to help 
users of the NIST computer facilities. The GAMS taxonomy for integration 
routines is reproduced on page 258. The integration routines listed in 
GAMS are reproduced on page 260. 

There are many computer routines that are not described in the NIST 
guide, some of which are described in the Notes. 


Notes 

[1] Appendix 2 of Davis and Rabinowitz [3] contains a collection of FORTRAN 
integration routines. 

[2] Appendix 3 of Davis and Rabinowitz [3] contains a bibliography of papers 
describing ALGOL, FORTRAN, and PL/1 integration routines. 

[3] In the books by Press et al. (see, for example, [10]), there are a collection 
of C, FORTRAN, and PASCAL integration routines. 
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[4] Quadpack, a library of FORTRAN routines for one-dimensional integration 
by Piessens at al. [9], has the following system for naming its routines: 


e The first letter is always “Q”; 
e The second letter is “N” for a non-adaptive integrator or “A” for an 
adaptive integrator; 
e The third letter is “G” is for a general (user-defined) integrand or “W” 
for one of several weight functions; 
The fourth letter is 
“S” if routine handles singularities well, 
“Pp” if the location of points of special difficulty (such as singularities) 
can be input by the user, 
“I” if the region of integration is infinite, 
“OQ” if the weight function is oscillatory (i.e., is a sine or cosine func- 
tion), 
“F” for a Fourier integral, 
“C” for a Cauchy principal-value integral, 
“E—” for an extended parameter list (allows more user control). 


Figures Figure 57.1 and Figure 57.2 show decision trees from Piessens 
at al. [9] that lead the user to the correct Quadpack routines. 

[5] Quadlib [11] is a PC package derived from Quadpack. It contains the 
high-level double precision Quadpack subroutines along with an extensive 
collection of sample programs, test programs, and skeleton files. 

[6] Many scientific software routines, including those for integration, may be 
obtained for free (via electronic mail) from a variety of computer networks. 
For example, all of the Quadpack [9] routines are available. To receive 
instructions on how to obtain this software, send the mail message “send 
index” to one of the following five addresses: 


netlib@research.att.com 
netlib@ornl.gov 
netlib@nac.no 
netlib@draci.cs.uow.edu.au 
uunet!research!netlib 


See the article by Dongarra and Grosse [5] for details. . 

[7] Many of the symbolic manipulation languages (see page 117) can also eval- 
uate integrals numerically. 

[8] Note that there are times when it is not wise to use an automatic quadrature 
routine, see Lyness [8]. 
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b 
j £(x)dax, a and b finite. 
a 
Can you factorize the integrand as 
w(x). £(x) where £ is smooth on [a,b], 
and w(x)#cos(ex) or sin(©x)? 


Can you factorize the integrand as 
w(x) f(x) where f£ is smooth on [a,b], 
w( x)= (x-a) *(b-x) 210g *(x-a) log*(b-x) 


Use QAWS or QAWSE 


YES 
with k, 290 or 1 and ©,6>-1, b>»a ? 
No 
Can you factorize the integrand 
as w(x) f(x) where f is smooth 
on [a,b], and w(x)@1/(x-c)? YES 
yo 
Do you care about computer time, 
and are you willing to do some 
analysis of the problem? NO 
YES 
YES 
NO 
Split the integration 
Are there discontinuities or singu- range at the points where 
larities of the integrand or of ite YES | difficulties occur,and do 


derivative within the interval, and 
do you know where they are? 
NO 


your analysis for each sub- 
interval separately. You can 
also use QAGP, which is to 

be provided with the abscis- 
sae of the points involved. 


Has the integrand end-point singu- 
larities? 


NO YES 
Has the integrand an oscillatory 
behaviour of non-specific type, and 
no singularities? 
No 
Use QAGS. If this routine returns an error flag you are advised to do 
more analysis in order to reduce the degree of difficulty of your 
problem. QAGE may be of help for locating possible difficult spots 
of the integrand. 


Use QAG with KEY = 6 


Figure 57.1. Decision tree for finite-range integration from Piessens at al. [9]. 
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[ £(x)ax, | (x)ax, | f£(x)dax, a finite 


a —co Oo 


Does the integrand decay 
rapidly to zero for x-+=, 


Xo~ 2 


Truncate the interval and go to 
Section 4.2 for integration over 
the remaining finite range. 


Is the integral a Fourier 
YES | transform? 


YES 


Do you care about computer 

time and are you willing to 

do some analysis of the YES 
problem? 


Does the integrand oscillate 
over the entire infinite 
range? 


Sum successive positive and nega- 
tive contributions by integrating 
between zeros of the integrand (go 
to Section 4.2). Apply convergence 
acceleration by means of routine 
Qexr (Section 3.4.2) which 

implements the e-algorithnm. 


No 


Use QAGI for integration over 
the infinite range 


Has the integrand a non-smooth behaviour 
in the integration range, and do you 

know where it occurs? -A singularity at 
the finite integration limit is allowed.- 


NO YES 
(1) 


For integration over the infinite 
range 


Split off finite subranges at the 
points where non-smooth behaviour 
occurs, and use appropriate fi- 
nite-range integration on these 
subranges (go to Section 4.2). 


~- truncation of the interval, 

- or application of a suitable 
transformation for reducing 
the problem to integration 
over a finite interval 

may be possible. 

You can also apply QAGI. 


Por integration over the 
infinite subinterval go to (1). 


Figure 57.2. Decision tree for infinite-range integration from Piessens at al. [9]. 
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Applicable to Definite integrals. 


Yields 
The software category code appropriate for a specific numerical inte- 
gration problem. 


Procedure 

A taxonomy for integration software has been developed as part of the 
GAMS project at the National Institute of Standards and Technology [1]. 
This section contains the taxonomy of integration routines from GAMS [2]. 


Example 

Suppose that a multidimensional integration must be performed nu- 
merically. If the integrand is known analytically, and the integration region 
is a hyper-rectangle, then software in the category code H2b1 is required. 
Most modern software comes with the appropriate category codes, which 
makes it easy to determine if some software is appropriate for a spe- 
cific problem. This category code can be used when searching electronic 
databases, such as MathSci [3] or Netlib [4]. 
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Taxonomy 


H2. 
H2a. 
H2al. 
H2ala. 


H2alal. 
H2ala2. 


H2alb. 


H2albl1. 
H2al1b2. 


H2az2. 


H2a2a. 


H2a2al. 
H2a2a2. 


H2a2b. 


H2a2bl. 
H2a2b2. 


H2a3. 
H2a3a. 


H2a3al. 
H2a3a2. 


H2a4. 
H2a4a. 


H2a4al. 
H2a4a2. 


H2b. 
H2bl1. 
H2bla. 


H2bi1al. 
H2b1la2. 


H2b1b. 


H2b1bl1. 
H2b1b2. 


H2b2. 
H2b2a. 


H2b2al. 
H2b2a2. 


H2b2b. 


H2b2b1. 
H2b2b2. 


H2c. 


Note 


Quadrature (numerical evaluation of definite integrals) 
One dimensional integrals 

Finite interval (general integrand) 

Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Integrand available only on a grid 

Automatic (user need only specify desired accuracy) 
Nonautomatic 

Finite interval (specific or special type integrands including weight 
functions, oscillating and singular integrands, principal values inte- 
grals, splines, etc.) 

Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Integrand available only on a grid 

Automatic (user need only specify desired accuracy) 
Nonautomatic 

Semi-infinite interval (including e~* weight function) 
Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Infinite interval (including e= weight function) 
Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Multidimensional integrals 

One or more hyper-rectangular regions (includes iterated integrals) 
Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Integrand available only on a grid 

Automatic (user need only specify desired accuracy) 
Nonautomatic 

n dimensional quadrature on a nonrectangular region 
Integrand available via user-defined procedure 
Automatic (user need only specify desired accuracy) 
Nonautomatic 

Integrand available only on a grid 

Automatic (user need only specify desired accuracy) 
Nonautomatic 

Service routines (compute weight and nodes for quadrature formu- 
las) 


[1] GAMS [2] does not list software for all of the above categories. 
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59. Software Libraries: 
Excerpts from GAMS 


Applicable to Definite integrals. 


Yields 
Software appropriate for a specific integration problem. 


Procedure 

A taxonomy and description of mathematical and statistical routines 
in use at the National Institute of Standards and Technology (NIST) has 
been constructed, see Boisvert et al. [1]. The NIST guide, called GAMS [2], 
was assembled to help users of the NIST computer facilities. Since NIST 
has many software packages, many people outside of NIST have found the 
guide useful despite its limited coverage. This section contains the GAMS 
listing of integration routines, by software category code (see page 258). 

The following computer libraries (mostly in FORTRAN) are referred 
tof. Their inclusion does not constitute an endorsement. Nor does it 
necessarily imply that unnamed packages are not worth trying. 


e CMLIB [3] 

e Collected Algorithms of the ACM 
e IMSL [4] 

e NAG [5] 

e NMS [6] 

e PORT [7] 

e Scientific Desk [8] 

e SCRUNCH {9] 


{ Identification of commercial products does not imply recommendation or 
endorsement by NIST. 
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Excerpts from GAMS 


H2al1al: 


Automatic 1-D finite interval quadrature (user need 


only specify required accuracy), integrand available 


A614 


QIDA 


QIDAX 


Q1DB 


QAG 
QAGE 


QAGS 


QAGSE 


QNG 


DCADRE 


QDAG 


QDAGS 
QDNG 


via user-defined procedure 
Collected Algorithms of the ACM 


INTHP: a Fortran subroutine for automatic numerical integration 


in Hp. The functions may have singularities at one or both 
endpoints of an interval. Each of finite, semi-infinite, and in- 
finite intervals are admitted. (See K. Sikorski, F. Stenger, and 
J. Schwing, ACM TOMS 10 (1984) pp. 152-160.) 


CMLIB Library (Q1DA Sublibrary) 


Automatic integration of a user-defined function of one variable. 
Special features include randomization and singularity weaken- 
ing. 

Flexible subroutine for the automatic integration of a user-defined 
function of one variable. Special features include randomization, 
singularity weakening, restarting, specification of an initial mesh 
(optional), and output of smallest and largest integrand values. 
Automatic integration of a user-defined function of one variable. 
Integrand must be a Fortran FUNCTION but user may select 
name. Special features include randomization and singularity 
weakening. Intermediate in usage difficulty between QIDA and 
Q1DAX. 


CMLIB Library (QUADPKS Sublibrary) 


Automatic adaptive integrator, will handle many non-smooth 
integrands using Gauss-Kronrod formulas. 
Automatic adaptive integrator, can handle most non-smooth 
functions, also provides more information than QAG. 
Automatic adaptive integrator, will handle most non-smooth in- 
tegrands including those with endpoint singularities, uses extrap- 
olation. 
Automatic adaptive integrator, can handle integrands with end- 
point singularities, provides more information than QAGS. 
Automatic non-adaptive integrator for smooth functions, using 
Gauss-Kronrod-Patterson formulas. 

IMSL Subprogram Library 


Numerical integration of a function using cautious adaptive Rom- 
berg extrapolation. 
IMSL MATH/LIBRARY Subprogram Library 


Integrate a function using a globally adaptive scheme based on 


Gauss-Kronrod rules. 
Integrate a function (which may have endpoint singularities). 


Integrate a smooth function using a nonadaptive rule. 
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QDAGS 


DEFINT 


DO1LAHF 


DO1AJF 


DO1IARF 


DO1BDF 


QIDA 


ODEQ 


QUAD 


RQUAD 


H2A1 


H2A1U 


SIMP 


H2ala2: 
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IMSL STAT/LIBRARY Subprogram Library 
Integrate a function (which may have endpoint singularities). 
JCAM Software Library 


Uses double exponential transformation of Mori to compute def- 
inite integral automatically to user specified accuracy. 


NAG Subprogram Library 


Computes a definite integral over a finite range to a specified 
relative accuracy using a method described by Patterson. 

Is a general-purpose integrator which calculates an approxima- 
tion to the integral of a function F(x) over a finite interval (A,B). 
Computes definite and indefinite integrals over a finite range to a 
specified relative or absolute accuracy, using a method described 
by Patterson. 

Calculates an approximation to the integral of a function over 
a finite interval (A,B). It is non-adaptive and as such is rec- 
ommended for the integration of smooth functions. These ex- 
clude integrands with singularities, derivative singularities or high 
peaks on (A,B), or which oscillate too strongly on (A,B). 


NMS Subprogram Library 


Automatic integration of a user-defined function of one variable. 
Special features include randomization and singularity weaken- 
ing. 


PORT Subprogram Library 


Finds the integral of a set of functions over the same interval 
by using the differential equation solver ODES1. For smooth 
functions. 

Finds the integral of a general user defined EXTERNAL function 
by an adaptive technique to given absolute accuracy. 

Finds the integral of a general user defined EXTERNAL function 
by an adaptive technique. Combined absolute and relative error 
control. 


Scientific Desk PC Subprogram Library 


Automatically evaluates the definite integral of a user defined 
function of one variable. 
Automatically evaluates the definite integral of a user defined 
function of one variable. 


SCRUNCH Subprogram Library 


Calculates an estimate of the definite integral of a user supplied 
function by adaptive quadrature. In BASIC. 


Nonautomatic 1-D finite interval quadrature, inte- 
grand available via user-defined procedure 
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QK15 
QK21 
QK31 
QK41 
QK51 


QK61 


DO1BAF 


QK15 


H2alb2: 


DOIGAF 


PCHQA 


CSPQU 


H2A1T 


CMLIB Library (QUADPKS Sublibrary) 


Evaluates integral of given function on an interval with a 15 point 
Gauss-Kronrod formula and returns error estimate. 
Evaluates integral of given function on an interval with a 21 point 
Gauss-Kronrod formula and returns error estimate. 
Evaluates integral of given function on an interval with a 31 point 
Gauss-Kronrod formula and returns error estimate. 
Evaluates integral of given function on an interval with a 41 point 
Gauss-Kronrod formula and returns error estimate. 
Evaluates integral of given function on an interval with a 51 point 
Gauss-Kronrod formula and returns error estimate. 
Evaluates integral of given function on an interval with a 61 point 
Gauss—Kronrod formula and returns error estimate. 


NAG Subprogram Library 


Computes an estimate of the definite integral of a function of 
known analytical form, using a Gaussian quadrature formula with 
a specified number of abscissae. Formulae are provided for a 
finite interval (Gauss-Legendre), a semi-infinite interval (Gauss- 
Laguerre, Gauss-Rational), and an infinite interval 
(Gauss—Hermite). 


NMS Subprogram Library 


Evaluates integral of given function on an interval with a 15 point 
Gauss-Kronrod formula and returns error estimate. 


Nonautomatic 1-D finite interval quadrature, inte- 
grand available only on a grid 


NAG Subprogram Library 


Integrates a function which is specified numerically at four or 
more points, over the whole of its specified range, using third- 
order finite-difference formulae with error estimates, according 
to a method due to Gill and Miller. 


NMS Subprogram Library 
Integrates piecewise cubic from A to B given N-arrays X,F,D. 
Usually used in conjunction with PCHEZ to form cubic, but 


can be used independently, especially if the abscissae are equally 
spaced. 


PORT Subprogram Library 
Finds the integral of a function defined by pairs (x,y) of input 


points. The x’s can be unequally spaced. Uses spline interpola- 
tion. 


Scientific Desk PC Subprogram Library 


Computes the integral of the array f between x(i) and x(j), given 
n points in the plane (x(k),f(k)), k=1,...,n. 
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BFQAD 


PFQAD 


QAGP 
QAGPE 
QAWC 
QAWCE 


QAWO 


QAWOE 
QAWS 


QAWSE 


QMOMO 


QDAGP 
QDAWC 


QDAWO 
QDAWS 


DO1AKF 
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Automatic 1-D finite interval quadrature (user need 
only specify required accuracy) (special integrand 
including weight functions, oscillating and singular 
integrands, principal value integrals, splines, etc.), 
integrand available via user-defined procedure 


CMLIB Library (BSPLINE Sublibrary) 


Integrates function times derivative of B-spline from X1 to X2. 
The B-spline is in B representation. 

Computes integral on (X1,X2) of product of function and the 
ID-th derivative of B-spline which is in piecewise polynomial 
representation. 


CMLIB Library (QUADPKS Sublibrary) 


Automatic adaptive integrator, allows user to specify location of 
singularities or difficulties of integrand, uses extrapolation. 
Automatic adaptive integrator for function with user specified 
endpoint singularities, provides more information that QAGP. 
Cauchy principal value integrator, using adaptive Clenshaw-Curtis 
method (real Hilbert transform). 

Cauchy principal value integrator, provides more information than 
QAWC (real Hilbert transform). 

Automatic adaptive integrator for integrands with oscillatory sine 
or cosine factor. 

Automatic integrator for integrands with explicit oscillatory sine 
or cosine factor, provides more information than QAWO. 
Automatic integrator for functions with explicit algebraic and/or 
logarithmic endpoint singularities. 

Automatic integrator for integrands with explicit algebraic and/or 
logarithmic endpoint singularities, provides more information than 
QAWS. 

Computes integral of k-th degree Chebyshev polynomial times 
one of a selection of functions with various singularities. 


IMSL MATH/LIBRARY Subprogram Library 
Integrate a function with singularity points given. 


Integrate a function F(x)/(x-c) in the Cauchy principal value 
sense. 
Integrate a function containing a sine or a cosine. 


Integrate a function with algebraic-logarithmic singularities. 
NAG Subprogram Library 


Is an adaptive integrator, especially suited to oscillating, non- 
singular integrands, which calculates an approximation to the 
integral of a function F(x) over a finite interval (A,B). 
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DO1ALF Is a general purpose integrator which calculates an approximation 
to the integral of a function F(x) over a finite interval (A,B), 
where the integrand may have local singular behavior at a finite 
number of points within the integration interval. 

DO1ANF Calculates an approximation to the cosine or the sine transform 
of a function G over (A,B), i-e., the integral of G(x)cos(wx) or 
G(x)sin(wx) over (A,B) (for a user-specified value of w). 

DO1LAPF Is an adaptive integrator which calculates an approximation to 
the integral of a function G(x)W(x) over (A,B) where the weight 
function W has end-point singularities of algebraic-logarithmic 
type (see input parameter KEY). 

DO1AQF Calculates an approximation to the Hilbert transform of a func- 
tion G(x) over (A,B), i.e., the integral of G(x)/(x-c) over (A,B), 
for user-specified values of A,B,C. 

PORT Subprogram Library 


BQUAD Adaptively integrates functions which have discontinuities in their 
derivatives. User can specify these points. 


H2a2a2: Nonautomatic 1-D finite interval quadrature (spe- 
cial integrand including weight functions, oscillating 
and singular integrands, principal value integrals, 
splines, etc.), integrand available via user-defined 
procedure 


CMLIB Library (QUADPKS Sublibrary) 


QC25C Uses 25 point Clenshaw-—Curtis formula to estimate integral of 
F(x)W(x) where W(x)=1/(x-c). 

QC25F Clenshaw-Curtis integration rule for function with cos or sin 
factor, also uses Gauss-Kronrod formula. 

QC25S Estimates integral of function with algebraic-logarithmic singu- 
larities using 25 point Clenshaw-—Curtis formula and gives error 
estimate. 

QK15W Evaluates integral of given function times arbitrary weight func- 
tion on interval with 15 point Gauss—-Kronrod formula and gives 
error estimate. 


H2a2b1: Automatic 1-D finite interval quadrature (user need 
only specify required accuracy) (special integrand 
including weight functions, oscillating and singular 
integrands, principal value integrals, splines, etc.), 


integrand available only on a grid 


CMLIB Library (BSPLINE Sublibrary) 


BSQAD Computes the integral of a B-spline from X1 to X2. The B-spline 
must be in B representation. 

PPQAD Computes the integral of a B-spline from X1 to X2. The B-spline 
must be in piecewise polynomial representation. 
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DCSQDU 


BSITG 


E02AJF 


E02BDF 


BSPLI 


SPLNI 


E3HIN 


E3INT 


H2a3al: 


A614 


A639 


QAGI 


QAGIE 
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IMSL Subprogram Library 
Cubic spline quadrature. 
IMSL MATH/LIBRARY Subprogram Library 
Evaluate the integral of a spline, given its B-spline representation. 
NAG Subprogram Library 


Determines the coefficients in the Chebyshev series representation 
of the indefinite integral of a polynomial given in Chebyshev series 
form. 

Computes the definite integral of a cubic spline from its B-spline 


representation. 
PORT Subprogram Library 


Obtains the integrals of basis splines, from the left-most mesh 
point to a specified set of points. 

Integrates a function described previously by an expansion in 
terms of B-splines. Several integrations can be performed in one 
call. 


Scientific Desk PC Subprogram Library 


Evaluates the definite integral of a piecewise cubic Hermite func- 
tion over an arbitrary interval. 

Evaluates the definite integral of a piecewise cubic Hermite func- 
tion over an interval whose endpoints are data points. 


Automatic 1-D semi-infinite interval quadrature (user 
need only specify required accuracy) (including e~*) 
weight function), integrand available via user-defined 
procedure 


Collected Algorithms of the ACM 


INTHP: a Fortran subroutine for automatic numerical integration 
in Hp. The functions may have singularities at one or both 
end-points of an interval. Each of finite, semi-infinite, and in- 
finite intervals are admitted. (See K. Sikorski, F. Stenger, and 
J. Schwing, ACM TOMS 10 (1984) pp. 152-160.) 

OSCINT: a Fortran subprogram for the automatic integration of 
some infinitely oscillating tails. That is, the evaluation of the 
integral from a to infinity of h(x)j(x), where h(x) is ultimately 
positive, and j(x) is either a circular function (e.g., cosine) or a 
first-kind Bessel function of fractional order. (See J. Lyness and 
G. Hines, ACM TOMS 12 (1986) pp. 24-25.) 


CMLIB Library (QUADPKS Sublibrary) 


Automatic adaptive integrator for semi-infinite or infinite inter- 
vals. Uses nonlinear transformation and extrapolation. 
Automatic integrator for semi-infinite or infinite intervals and 
general integrands, provides more information than QAGI. 
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QAWF Automatic integrator for Fourier integrals on (a,oco) with factors 
sin(wx), cos(wx) by integrating between zeros. 
QAWFE Automatic integrator for Fourier integrals, with sin(wx) factor on 


(a,oo), provides more information than QAWF. 
IMSL MATH/LIBRARY Subprogram Library 
QDAGI Integrate a function over an infinite or semi-infinite interval. 
QDAWF Compute a Fourier integral. 
JCAM Software Library 


DEHINT Uses double exponential transformation of Mori to compute semi- 
infinite range integral automatically to user specified accuracy. 


NAG Subprogram Library 


DO1AMF Calculates an approximation to the integral of a function F(x) 
over an infinite or semi-infinite interval (A,B). 


NMS Subprogram Library 


QAGI Automatic adaptive integrator for semi-infinite or infinite inter- 
vals. Uses nonlinear transformation and extrapolation. 


H2a3a2: 


Nonautomatic 1-D semi-infinite interval quadrature) 
(including e~* weight function), integrand available 
via user-defined procedure 


CMLIB Library (QUADPKS Sublibrary) 


QK15I Evaluates integral of given function on semi-infinite or infinite 
interval with a transformed 15 point Gauss—Kronrod formula and 
gives error estimate. 


NAG Subprogram Library 


DO1IBAF Computes an estimate of the definite integral of a function of 
known analytical form, using a Gaussian quadrature formula with 
a specified number of abscissae. Formulae are provided for a 
finite interval (Gauss—Legendre), a semi-infinite interval (Gauss- 
Laguerre, Gauss-rational), and an infinite interval 
(Gauss-Hermite). 


H2a4al1: Automatic 1-D infinite interval quadrature (user need 


e e e e _— 2 
only specify required accuracy) (including e~” ) 
weight function), integrand available via user-defined 
procedure 


Collected Algorithms of the ACM 


A614 INTHP: a Fortran subroutine for automatic numerical integration 
in Hp. The functions may have singularities at one or both 
end-points of an interval. Each of finite, semi-infinite, and in- 
finite intervals are admitted. (See K. Sikorski, F. Stenger, and 
J. Schwing, ACM TOMS 10 (1984) pp. 152-160.) 
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CMLIB Library (QUADPKS Sublibrary) 


QAGI Automatic adaptive integrator for semi-infinite or infinite inter- 
vals. Uses nonlinear transformation and extrapolation. 
QAGIE Automatic integrator for semi-infinite or infinite intervals and 


general integrands, provides more information than QAGI. 
NAG Subprogram Library 


DOLAMF Calculates an approximation to the integral of a function F(x) 
over an infinite or semi-infinite interval (A,B). 


NMS Subprogram Library 


QAGI Automatic adaptive integrator for semi-infinite or infinite inter- 
vals. Uses nonlinear transformation and extrapolation. 


H2a4a2: Nonautomatic 1-D infinite interval quadrature (in- 
cluding e-*’) weight function), integrand available 


via user-defined procedure 


CMLIB Library (QUADPKS Sublibrary) 


QK1i5I Evaluates integral of given function on semi-infinite or infinite 
interval with a transformed 15 point Gauss—Kronrod formula and 
gives error estimate. 


NAG Subprogram Library 


DOIBAF Computes an estimate of the definite integral of a function of 
known analytical form, using a Gaussian quadrature formula with 
a specified number of abscissae. Formulae are provided for a 
finite interval (Gauss—Legendre), a semi-infinite interval (Gauss— 
Laguerre, Gauss-rational), and an infinite interval 
(Gauss—Hermite). 


H2bial: Automatic n-D quadrature (user need only specify 
required accuracy) on one or more hyper-rectangular 


regions, integrand available via user-defined proce- 
dure 


CMLIB Library (ADAPT Sublibrary) 


ADAPT Computes the definite integral of a user specified function over 
a hyper-rectangular region in 2 through 20 dimensions. User 
specifies tolerance. A restarting feature is useful for continuing a 
computation without wasting previous function values. 


IMSL Subprogram Library 
DBLIN Numerical integration of a function of two variables. 


DMLIN Numerical integration of a function of several variables over a 
hyper-rectangle (Gaussian method). 
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QAND 
TWODQ 


DO1DAF 


DOIEAF 


DO1FCF 


DO01GBF 


H2b1a2: 


DO1FBF 


DO1FDF 


D01GCF 


H2b1b2: 


IMSL MATH/LIBRARY Subprogram Library 
Integrate a function on a hyper-rectangle. 


Compute a two-dimensional iterated integral using internal calls 
to a one-dimensional automatic integrator. 


NAG Subprogram Library 


Attempts to evaluate a double integral to a specified absolute 
accuracy by repeated applications of the method described by 
Patterson. 

Computes approximations to the integrals of a vector of similar 


functions, each defined over the same multi-dimensional hyper- 
rectangular region. The routine uses an adaptive subdivision 
strategy, and also computes absolute error estimates. 

Attempts to evaluate a multidimensional integral (up to 15 di- 
mensions), with constant and finite limits, to a specified relative 
accuracy, using an adaptive subdivision strategy. 

Returns an approximation to the integral of a function over a 
hyper-rectangular region, using a Monte-Carlo method. An ap- 
proximate relative error estimate is also returned. This routine 
is suitable for low accuracy work. 


Nonautomatic n-D quadrature on one or more hyper- 
rectangular regions, integrand available via user- 
defined procedure 


NAG Subprogram Library 


Computes an estimate of a multidimensional integral (from 1 
to 20 dimensions), given the analytic form of the integrand and 
suitable Gaussian weights and abscissae. 

Calculates an approximation to a definite integral in up to 30 
dimensions, using the method of Sag and Szekeres. The region of 
integration is an n-sphere, or by built-in transformation via the 
unit n-cube, any product region. 

Calculates an approximation to a definite integral in up to 20 di- 
mensions, using the Korobov-—Conroy number theoretic method. 


Nonautomatic n-D quadrature on one or more hyper- 


rectangular regions, integrand available only on a 
grid 


DBCQDU 


BS21IG 


BS3IG 


IMSL Subprogram Library 
Bicubic spline quadrature. 
IMSL MATH/LIBRARY Subprogram Library 


Evaluate the integral of a tensor-product spline on a rectangular 
domain, given its tensor-product B-spline representation. 
Evaluate the integral of a tensor-product spline in three dimen- 
sions over a three-dimensional rectangle, given its tensor-product 
B-spline representation. 
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H2b2al: 


Automatic n-D quadrature on a nonrectangular re- 
gion (user need only specify required accuracy), in- 
tegrand available via user-defined procedure 


Collected Algorithms of the ACM 


A584 CUBTRI: a Fortran subroutine for adaptive cubature over a tri- 
angle. (See D. P. Laurie, ACM TOMS 8 (1982) pp. 210-218.) 
A612 TRIEX: a Fortran subroutine for integration over a triangle. Uses 


an adaptive subdivisional strategy with global acceptance criteria 
and incorporates the epsilon algorithm to speed convergence. (see 
E. de Doncker and I. Robinson, ACM TOMS 10 (1984) pp. 17- 
22.) 


CMLIB Library (TWODQ Sublibrary) 


TWODQ Automatic (adaptive) integration of a user specified function 
f(x,y) on one or more triangles to a prescribed relative or abso- 
lute accuracy. Two different quadrature formulas are available 
within TWODQ. This enables a user to integrate functions with 
boundary singularities. 


NAG Subprogram Library 


DOIJAF Attempts to evaluate an integral over an n-dimensional sphere 
(n=2, 3, or 4), to a user specified absolute or relative accuracy, 
by means of a modified Sag—Szekeres method. The routine can 
handle singularities on the surface or at the center of the sphere, 
and returns an error estimate. 


Scientific Desk PC Subprogram Library 


H2B2A Computes the two-dimensional integral of a function f over a 
region consisting of n triangles. 


Nonautomatic n-D quadrature on a nonrectangular 


region, the integrand available via user-defined pro- 
cedure 


JCAM Software Library 


DTRIA Computes an approximation to the double integral of f(u,v) over a 
triangle in the uv-plane by using an n? point, generalized Gauss- 
Legendre product rule of polynomial degree precision 2n-2. From 
“Computation of Double Integrals over a Triangle,” by F. G. 
Lether, Algorithm 007, J. Comp. Appl. Math. 2(1976), pp. 219- 
224. 


NAG Subprogram Library 


DO1PAF Returns a sequence of approximations to the integral of a function 
over a multi-dimensional simplex, together with an error estimate 
for the last approximation. 
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H2ce: 


A647 


A655 


A659 


FQRUL 


GQRCF 


GQRUL 


RECCF 
RECQR 


DO1IBBF 


D01BCF 


GAUSQ 
GQOIN 


GQM11 


Service routines for quadrature (compute weight 
and nodes for quadrature formulas) 


Collected Algorithms of the ACM 


Fortran subprograms for the generation of sequences of quasiran- 
dom vectors with low discrepancy. Such sequences may be used to 
reduce error bounds for multidimensional integration and global 
optimization. (See B. L. Fox, ACM TOMS 12 (1986) pp. 362- 
376.) 

IQPACK: Fortran routines for the stable evaluation of the weights 
and nodes of interpolatory and Gaussian quadratures with pre- 
scribed simple or multiple knots. (See S. Elhay and J. Kautsky, 
ACM TOMS 13 (1987) pp. 399-415.) 

A Fortran implementation of Sobol’s quasirandom sequence gen- 
erator for multivariate quadrature and optimization. (See P. Brat- 
ley and B. L. Fox, ACM TOMS 14 (1988) pp. 88-100.) 


IMSL MATH/LIBRARY Subprogram Library 


Compute a Fejer quadrature rule with various classical weight 
functions. 

Compute a Gauss, Gauss-Radeau or Gauss—Lobatto quadrature 
rule given the recurrence coefficients for the monic polynomials 
orthogonal with respect to the weight function. 

Compute a Gauss, Gauss—Radeau or Gauss—Lobatto quadrature 
rule with various classical weight functions. 

Compute recurrence coefficients for various monic polynomials. 


Compute recurrence coefficients for monic polynomials given a 
quadrature rule. 


NAG Subprogram Library 


Returns the weights and abscissae appropriate to a Gaussian 
quadrature formula with a specified number of abscissae. The 
formulae provided are Gauss—Legendre, Gauss-rational, Gauss- 
Laguerre and Gauss-Hermite. 

Returns the weights (normal or adjusted) and abscissae for a 
Gaussian integration rule with a specified number of abscissae. 
Six different types of Gauss rule are allowed. 


PORT Subprogram Library 
Finds the abscissae and weights for Gauss quadrature on the 


interval (a,b) for a general weight function with known moments. 
Finds the abscissae and weights for Gauss-Laguerre quadrature 
on the interval (0,400). 

Finds the abscissae and weights for Gauss-Legendre quadrature 
on the interval (—1,1). 
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Notes 
[1] In the excerpts section, ACM TOMS stands for ACM Trans. Math. Soft- 
ware. 


[2] Software is not listed for all the taxonomy classes that have been established. 
[3] The author thanks Dr. Ronald Boisvert of NIST for making part of GAMS 
available electronically. 
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[1] R. F. Boisvert, S. E. Howe, and D. K. Kahaner, “GAMS: A Framework for 
the Management of Scientific Software,” ACM Trans. Math. Software, 11, 
No. 4, December 1985, pages 313-355. 

[2] R. F. Boisvert, S. E. Howe, D. K. Kahaner, and J. L. Springmann, Guide to 
Available Mathematical Software, NISTIR 90-4237, Center for Computing 
and Applied Mathematics, National Institute of Standards and Technology, 
Gaithersburg, MD, March 1990. 

[3] CMLIB, this is a collection of code from many sources that NIST has 
combined into a single library. The relevant sublibraries are 
(A) CDRIV and SDRIV, see D. Kahaner, C. Moler, and S. Nash, Numerical 

Methods and Software, Prentice—Hall Inc., Englewood Cliffs, NJ, 1989. 
(B) DEPAC: Code developed by L. Shampine and H. A. Watts. 
(C) FISHPAK: Code developed by P. N. Swartztrauber and R. A. Sweet. 
(D) VHS3: Code developed by R. A. Sweet. 

[4] IMSL Inc., 2500 Park West Tower One, 2500 City West Blvd., Houston, TX 
77042. 

(5) NAG, Numerical Algorithms Group, Inc., 1400 Opus Place, Suite 200, Down- 
ers Grove, IL, 60515. 

[6] NMS, this is an internal name at NIST. The code is from D. Kahaner, C. 
Moler, and S. Nash, Numerical Methods and Software, Prentice-Hall Inc., 
Englewood Cliffs, NJ, 1989. 

[7] PORT, see P. Fox, et al., The PORT Mathematical Subroutine Library 
Manual, Bell Laboratories, Murray Hill, NJ, 1977. 

[8] Scientific Desk is distributed by M. McClain, NIST, Bldg 225 Room A151, 
Gaithersburg, MD 20899. 

[9] SCRUNCH, these are old, unsupported codes in BASIC. The codes are 
translations of Fortran algorithms from G. Forsythe, M. Malcom, and C. 
Moler, Computer Methods for Mathematical Computations, Prentice-Hall 
Inc., Englewood Cliffs, NJ, 1977. 


60. Testing Quadrature Rules 


Applicable to Numerical approximations to integrals. 


Idea 
Many integrals have been used as examples to test quadrature rules. 
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Procedure 

As new quadrature rules are developed, they are compared to existing 
quadrature rules in terms of accuracy and efficiency. Many authors have in- 
troduced example integrals to indicate the performance of their algorithms 
and implementations. We tabulate some of those integrals. 


2 
e Lyness [4] uses the test integral I(A) = | ESV ENT dz 


e Piessens et al. [5] uses the test integrals (the numbers correspond to 
their original numbering, numbers 4-6 represent previous integrals with 
different parameters): 


1) fr log (5) = ap 
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3) Se cos (2% sin) dz = mJo (2%) 
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11) ‘A log? (=) dr = T(a) 
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m) f (x — 2) ( PEN (CS hae 
27-* log (3) - 2-°—1 log ae —- tan7! (2°*?) — tan7' (2°) 
1+4°° 
e Berntsen et al. [1] uses the test integrals: 
1) So |a — A\™ dx feature: singularity 
2) to fo(x) dx feature: discontinuous 
3) So e~o3lz—Al dar feature: Co function 
° 10% 
4) / GF dx feature: one peak 
5) a y es Sh ST TD dx feature: four peaks 
6) i mee — A) cos(B(z — )*) dz feature: nonlinear oscillation 
ae : 
ss am and f2(z) = ee Aa 


e Hunter and Smith [3] use the principal-value integrals: 


n/2 
1) f cos(cos t) dt 
0 


k? — sin? t 


[o*) ent 
2 +—s dt 
) f =x 


whereO0<k<landaA>O. 


e Corliss and Rall (2] have a collection of test problems that exercise their 
interval analysis integration package: 


[3.1,3.2] 
1) / sin x dr 


(0,0.1] 
2) f,(B sin(Bx) — Asin(Az)) dx 


0.7 
3) | dx 
o6 1-2 


4) fy ude 
5) fy f(x) dz 
6) Sogldz 


7) So (x — 2) dz 
1 dz 
2 i 1+21 
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0, «+<0.3 


where A = [0.0.1] and B = (3.1, 3.2], and f(x) = { 1 >03° 
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61. Truncating an Infinite Interval 


Applicable to Integrals that have an infinite limit of integration. 


Yields 
An approximating integral, with a bound on the error. 


Idea 


By truncating an infinite integral, a numerical routine may have an 
easier computation. 


Procedure 

An infinite integral can always be truncated to a finite interval. Esti- 
mating the error made in the truncation process establishes the usefulness 
of the truncation. 


Example 
x 


oo 
Consider the integral J = [ ee 


limit of integration to be, say, a, then we have 


e-*’ dx. If we truncate the upper 


2 


a 
Iada= f =e?" de. 
0 l+2 
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In this case we can estimate the error made in the truncation process: 


foo) 
= Ss zt —2? 
I-Je = [ ag dx 


foe) 2 
</ ze” dr (61.1) 


<z for z>QO0. 


where we have used the approximation 


If we were to approximate J by numerically approximating J,, then 
we would need a > 4.3 to insure that I — J, < 1078. 


Reference 
[1] P. J. Davis and P. Rabinowitz, Methods of Numerical Integration, Second 
Edition, Academic Press, Orlando, Florida, 1984, page 205. 


VI 


Numerical Methods: 
Techniques 


62. Adaptive Quadrature 


Applicable to Integrals in any number of dimensions. 


Yields 
A numerical quadrature scheme. 


Idea 

If a numerical quadrature scheme does not result in a sufficiently 
accurate numerical approximation, then sampling the integrand at more 
nodes should increase the accuracy. However, the additional sampling only 
needs to be performed in problem areas (where the error estimates are 
large). 


Procedure 

Adaptive quadrature is an automatic procedure for increasing the 
accuracy of a numerical approximation to an integral by increasing the 
number of samples of the integrand. Additional samples only need to be 
taken where the quadrature scheme is having numerical difficulties. Hence, 
the overall scheme is given by the following steps: 
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tion 
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a b 
Figure 62. The geometry of an adaptive integration computation. The func- 


f(x) lies in the shaded triangles; the area of these triangles provide error 


estimates. 


[1] 
[2] 


[3] 


[4] 


Start with a given integral to be integrated over a given interval. 

Use a quadrature rule to approximate the integral over the entire 

interval; this is the global approximation. Estimate the error in this 

approximation; this is the global error. Place the interval, and the 

estimated error on that interval, onto a list. 

If the global error is not small enough, then: 

(A) Choose an interval from the list of intervals (presumably, choose 
the one with the largest estimated error). 

(B) Subdivide the chosen interval. 

(C) Approximate the integral over each of the new sub-intervals, and 
estimate the error in these approximations. 

(D) Update the list of intervals and the estimated error on each sub- 
interval. 

(E) Update the global approximation to the integral and the estimate 
of the global error. Go to step [3]. 

Done. 


Figure 62 shows an early stage in an adaptive integration computation. 


The adaptive strategy is to subdivide the largest shaded triangle. For the 
figure shown, the left-most region is the next to be sub-divided. 


Rice [12] determines that there are between 1 and 10 million adaptive 


algorithms that are potentially interesting and significantly different from 
one another. This number arises from the following: 


There are at least six different processor components. That is, the 
integration rules chosen for each sub-interval can be the same, or the 
sub-intervals can have different rules of the same order, or many other 
possibilities. 

For each choice of how the rules are to be chosen, there are at least 
five possibilities for each choice of rule. For example, using only three 
nodes per interval, there are the following methods: Simpson’s, 3-point 
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Gauss, 3-point Tschebyscheff—Gauss, 3-point Tschebyscheff, and open 

Newton-Cotes. 
e There are at least three ways in which to determine a bound on the 
error. 
There are many types of integrands that the routines could identify and 
handle specially. For instance, power-law singularities or discontinuous 
integrands might be identified. Note, though, that sometimes singu- 
larities at the endpoints of the region of integration can be ignored and 
the computation will still converge (see, for example, Myerson [10)). 
There are at least six different data structures for maintaining the list 
of intervals used at a given stage in an adaptive algorithm, including 
ordered lists, stacks, queues, and “boxes.” For each data structure, 
there are several significant variations. 


Rice [12] arrives at the pessimistic conclusion that there are potentially 1 
million research papers to be written, each with a novel algorithm that, for 
some test cases, is superior to the other 999,999 algorithms. 
Example 

Consider numerically evaluating the integral J = fe 4x° dx = 1 using 
adaptive quadrature. We must choose an integration rule and a measure 
of the error. Using the trapezoidal rule in the form 


[soa 


(b- a)? 


(b)) +E 


we find the error estimate E = — =) —————— f(2)(¢) for some ¢ € [a,b]. In this 


example f(?)(x) = 242 so we can Seana the error by |E| < 2(b—a)*b. An 
adaptive numerical computation can then proceed as follows: 


(1] We start with one interval equal to the entire range of integration: 


interval {[0, 1]} 

integral estimates {2} 

error estimates {2} 

Ix2 total error < 2. 


[2] We choose to subdivide the interval with the largest estimated error. 
Subdividing [0, 1] we find: 


intervals {[0, 4], [4, 1} 

integral estimates {0.125, 1.125} 

error estimates {0.125, 0.250} 

Is 1.25 total error < 0.375. 

[3] Now the largest error is in the interval [5,1], so we subdivide it to find: 

intervals (10, 31,2, 3113.13 

integral estimates {0.125, 0.2734, 0.7109} 

error estimates {0.125, 0.0234, 0.0313} 


I = 1.1093 total error < 0.1797. 
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[4] Now the largest error is in the interval [0, 3], so we subdivide it to find: 


intervals {[0, 3], (2, 3], (3. 3), (%, 1} 
integral estimates {0.0078, 0.0703, 0.2734, 0.7109} 
error estimates {0.0078, 0.0156, 0.0234, 0.0313} 
I = 1.0624 total error < 0.0781. 
[5] Now the largest error is in the interval [?, 1], so we subdivide it to find: 
intervals {[0, 4); (4, 4], [5 3], (3, AR ie 1)} 
integral estimates {0.0078, 0.0703, 0.2734, 0.2729, 0.4175} 
error estimates {0.0078, 0.0156, 0.0234, 0.0034, 0.0039} 
I = 1.0419 total error < 0.0541. 


At this point we can conclude that J lies in the range (0.99, 1.10]. 


Notes 

{1] The subdivision procedure used in most adaptive quadrature codes is a 
simple bisection of the chosen interval. Berntsen et al. [2] present an al- 
gorithm in which a subdivision strategy results in three non-equally sized 
sub-intervals. 

[2] When an adaptive algorithm is used, the nodes at which the integrand is 
evaluated cannot be determined beforehand. Therefore, adaptive techniques 
are inappropriate for tabulated integrands. 

[3] Most of the routines in Quadpack (see Piessens at al. (11]) are based on 
adaptive algorithms. 

[4] Corliss and Rall [4], who combine interval analysis methods (see page 218) 
with adaptive integration, estimate that the increase in CPU time for modest 
accuracy requests is about a factor of 3-5, and for stringent accuracy re- 
quests the factor is about 3-15. However, with a stringent accuracy request, 
the width of the final interval is only a few units in the last place (ULP). 
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63. Clenshaw—Curtis Rules 


Applicable to One-dimensional definite integrals. 


Yields 
A numerical quadrature scheme. 


Idea 

A function can be approximated by a (finite) linear combination of 
basis functions. If the integrated value of the basis functions is known, 
then an approximation of the integral is obtained. 


Procedure 

Let {¢,(z)} represent a set of functions for which the integrals s, := 
ie ¢n(z) dz are known. To approximate the value of J = i f(x) dz, we 
approximate the integrand by 


f(z) P~ ai¢i(z) + a2¢2(z) ps anon(z). 


Knowing the {a;,} values, we find that I + a;3; + ags2 +... + ansn. 

For the Clenshaw-Curtis rules, we take {a = —1, b = 1} and use the 
Tschebyscheff polynomials ¢(r) = T,(r) = cos (ncos~! xz). The first few 
such polynomials are T;(x) = 1, To(x) = x, and T3(x) = 2x? — 1. In this 
case we can write the {a,} analytically as 


is 
a, = =/ f (cos 6) cos(k@) dé. (63.1) 
ny 
To determine the value of a; numerically, as defined by (63.1), a technique 


may be used that is exact for trigonometric polynomials (see page 322). 
(That is, if f is a polynomial, then the exact value of a, will be returned.) 
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Example 


Consider the numerical evaluation of the integral J = 4/2 fo V1 — 2? dz. 
(The exact value is J = 1.) For the Tschebyscheff polynomials we can 


compute ; 
1 
81 =| Ty(c)dx = [ ldz = 1, 
0 0 


1 1 l 
a= | T,(c) dx = [ zdt =>, 
) i) 


1 1 1 
32> i T3(z) dz = [ (22? = 1) dx = —3 
0 i) 


1 1 
a= | T(z) do = [ (40° — 32) de = —5, 
_ Jo 0 


For our specific integrand, we can evaluate the integral in (63.1) to obtain 


a, = =f (vi — cos? a) cos(k@) dé 


fi 
a = / sin 6 cos(k@) d@ 
mn” Jo 
16 
n?(1 — k?) 


Therefore, we can approximate J by the series 


0 if k is odd, 
if k is even. 


The partial sum of this series after 2 terms is J ~ -, ~ 0.81. After 4 terms 
we obtain I = 3% ~ 1.08. 


Note 
(1) This method can be modified to account for integrals with weight functions; 
see Piessens at al. [4]. 
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64. Compound Rules 


Applicable to Definite integrals in any number of dimensions. 


Yields 
A numerical quadrature scheme. 


Idea 

If a numerical quadrature scheme is known for integration over a small 
parallelpiped region, then the rule may be repeatedly applied to find a rule 
applicable over a larger parallelpiped region. 


Procedure 

Suppose we seek to approximate an integral numerically over a large 
region. We may subdivide the region into smaller regions (often called 
“panels” ), and then apply a quadrature scheme in each of the smaller 
regions. The resulting quadrature rule, in the larger region, is called a 
compound rule. 


Example 
Simpson’s rule, in its most elementary form, approximates a one di- 
mensional integral using three nodes via 


b 


i, Galas = |r +4f (: - *) + a) . (64.1) 


To apply Simpson’s rule on a large interval, say from c to d, the larger 
region can be subdivided into smaller regions and Simpson’s rule applied 
in each of the smaller regions. 

If the interval [c,d] is subdivided into two equally spaced intervals, 
[c,e] and [e, d] (with e = (d+ c)/2), then 


r= [seer 
a 4 

=| f(e)de+ f f(z) dz, 

~ =e [1e) +4 (S42) + se] + 2 [sey + ar (5$*) + sa], 
d—c d—c ase ae: 


) +2g (c+2 7 )+4r(c+3 ; )+ #0), 


== [#0 +4f (c+ 


= Elsa sen sane ’ 


(64.2) 
where f, = f(c+ nh) and h = (e —c)/2 = (d—c)/4. 
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When manipulating integration rules, as above, it is often easier to 


just use subscripted variables. For example, the above derivation could be 
written as 


d 
ey f(x) da 
e d 
= 5 (fot Afi + fo) + 5 (fot Ais + fa) 


= zlfot+ Afi + 2fe + 4fs + Jal. 


If the original interval [c,d] had been divided into three equally sized 
intervals, instead of two, then the compound rule obtained would have been 


d 
rm | f(x) dz 
= * (fe +4f, + fo) + (fo + 4fs + fa) + (fe +4fs+fs) (64:3) 


= Z [fot Afi 42a + Aha + fat Afe+ fo 


where f,, = f(c+mk) and k = (d—c)/6. The extended form of Simpson’s 
rule, that is, the rule applied to n equal-width intervals, is: 


d 
[f tteyae = 5 | fo + 4h + fat Sans) 
c (64.4) 


+2(fot+ fat-->+ fon-2) + fon 


where fm = f(e+ mk) and k = (d—c)/(2n). 


Notes 
(1] A compound rule is sometimes called a composite rule. 


[2] Compound rules also exist for simplices. See, for example, Lyness [3] or De 
Donker [2]. 


65. Cubic Splines 285 


References 

[1] P. J. Davis and P. Rabinowitz, Methods of Numerical Integration, Second 
Edition, Academic Press, Orlando, Florida, 1984, pages 379-384. 

(2) E. De Doncker, “New Euler—Maclaurin Expansions and Their Application 
to Quadrature Over the s-Dimensional Simplex,” Math. of Comp., 33, 1978, 
pages 1003-1018. 

[3] J. M. Lyness, “Quadrature over a Simplex: Part 1. A Representation for the 
Integrand Function,” and “Quadrature over a Simplex: Part 2. A Represen- 
tation for the Error Functional,” SIAM J. Numer. Anal., 15, 1978, pages 
122-133 and 870-887. 

[4] J. N. Lyness and A. C. Genz, “On Simplex Trapezoidal Rule Families,” 
SIAM J. Numer. Anal., 17, 1980, pages 126-147. 

[5] A. Ralston, “A Family of Quadrature Formulas which Achieve High Accu- 
racy in Composite Rules,” J. ACM, 6, 1959, pages 384-394. 


65. Cubic Splines 


Applicable to One-dimensional definite integrals. 


Yields 
A numerical quadrature scheme. 


Idea 

Given data values of a function (not necessarily equally spaced), a 
cubic spline can be fit to those values, and then the integral of the cubic 
spline can be determined. 


Procedure 

Let (a, b] be a finite interval and assume that we have the points {z;} 
with a < 24, < 2g <--- < Fpy, <b and n > 2. Given the data values 
{f(x;)}, let S(z) be the natural cubic spline which interpolates those data 
values. That is, 


e S(zx) is a cubic polynomial in every interval (z;,2;41] (say this poly- 
nomial is S;(z)). 

e S(z) matches the data values at the nodes S;(z;) = f(x;) for i = 
1,...,n, and Sp(n41) = f(Zn+1). 

e At the nodes, S and its first and second derivatives are continuous: 
S;-1(2;) = S;:(2;), Si_ 1 (23) = Si (x4), and Si, (23) = Si’ (x3) for 27 = 
Quang tis 

e There is no curvature as the ends of the spline: S”(a) = S”(b) = 0 
(this is what makes the spline “natural” ). 


(In this definition we have implicitly assumed that a = xz; and 6 = y41, 
if this is not the case, then the range for i changes.) See Figure 65. 
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Si So Sn-1 Sn 
Ty 2 3 In-1 In Ln+1 


Figure 65. Location of the nodes {z,;} and the cubic polynomials {5;}. 


We can now approximate the integral of f by the integral of S and 
introduce an error E in doing so: 


b b 
/ Ovo / S(x)dz + E. (65.1) 


Example 

Consider approximating the integral J = = Io sin 7x dz. We choose to 
use the equally-spaced ae {xj} = {O4 +5) 4,1}. Hence, we have the 
data values {(0,0), (4,92 5} 2), (3,1), (3, 2 x2), (1, 0)}. 

We choose to represent the cubic on the interval [z;, 2:41] in the form 
S;(x) = a;(x — 2;)° + b;(2 — 2;)* + (x — x;) + d;. Using this notation the 
first few equations for the unknowns {a;, b;,c;,d; |i =1,...,4} are 


S:(0) = f(0) = ee 
Si/(0) =0 => b, = 0 
51 (Q=f()=¥2 =. gett + ight + 4 yatdh = 2 
Si (4) = S2 (4) => a1 + ¥§ Wh1 + cy +d, = de 
oH (4) = 5 (4) => fai+ 5 na +c, = C2 
Si (3) — SY (3) => Sai + b, = 2b2 

(3) =85 (3) = 

. a 


1 ON 
[oN 


Completing this list of equations, and solving the resulting linear 
system, results in the approximation 


interval [0, 4]: —4.8960(z — 0)° + 3.1340(z — 0) 
interval (4, 3]: —2.0288(x — 4)° — 3.6720(x — 4)? + 2.2164(x — 4) + 0.7071 
interval [4,3]: 2.0288(z — 3)° — 5.1936(2 - 3)? +1 


interval [3,1]: 4.8960(z — 3)° — 3.6720(x — $)? — 2.2164(2 — 3) + 0.7071. 
(65.2) 
Now we can determine the approximation to the integral: 


[prs f(a)de x a+ - yh + — Toth D ds (65.3) 
21 t=1 t=1 i=1 


Evaluating (65.3), when the coefficients are given in (65.2), results in the 
approximation J ~ 0.6362. (Note that the exact value is J = 2 ~ 0.6366.) 
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Notes 

[1] Among all functions S$ that are of class C?[a,5] which interpolate the data 
values, it is the cubic spline approximation that minimizes the “total curva- 
ture’: C = iD |S" (x)|? dz. 

{2] Cubic splines may be numerically computed by the software in Press et 
al. [5]. 

[3] oo a cubic splines does not result in a conventional quadrature rule. If the 
numerical approximation is written in the form L f(z) dz = ae wif (zi), 
then the weights {w;} depend on all of the function values { f(z;)}. 
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66. Using Derivative Information 


Applicable to Definite integrals. 
Yields 

A numerical quadrature scheme. 
Idea 


A quadrature rule can use the value of the integrand at the nodes, and 
it can also use the value of the derivative of the integrand at the nodes. 


Procedure 
A quadrature rule in the form 


b N M 
J seoyae = sf) + Dif (os) 
a k=1 


j=1 
can often be determined by making the rule exact for the polynomials 
| ee ag 
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Example 
Consider an integration rule of the form 


b 
i fa) de = af (0) + Bf(1) + 1f"(0) + 6F'(1). 


Making this rule be exact for f(x) = {1,2,z?,x*}, we obtain the following 
set of simultaneous equations: 


f(z) =1 => l=a+f 
f(z) =z = 4=P+y7+6 
f(x) =z? => 5 =B+26 
f(z) =2° = papas. 


These equations can be solved to obtain the approximation: 


1 
/ f(a) de ~ 400) +] +5 O - FQ). 


This rule is known as the corrected trapezoidal rule. 


Notes 

[1] Some of the common quadrature rules can be improved by including deriva- 
tive terms. The corrected trapezoidal rule is given in the example. The 
corrected midterm rule is 


1 
/ fl)de ~ (2) +2 [F')- FO]. 


[2] When either the corrected midterm rule or the corrected trapezoidal rule is 
compounded (see page 282), the derivative at the nodes in common cancel, 
so that only the derivatives at the end points remain. For example, the 
compounded corrected trapezoidal rule is 


[est [fo + 2f: + 2fo+.. + fart falta = (ta) - f'(b)|+E 


where f; = f(a+ih) and h = (b-—a)/n. It can be shown that the error is 

2 ae (4) ‘ eee 
bounded by |E| < 700" (b — a) max, | f (z)| (Davis and Rabinowitz [2], 
page 132). 


[3] The trapezoidal rule, corrected by using both f’ and f” terms, takes the 
form 


i. fla)de = * (f(a) + FO)+% [1 - FO] +25 7") + FO] +E 


= (6) 
0 _ 7 ——— f**/(¢) and a < ¢ < b (Davis and Rabinowitz [2], page 
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67. Gaussian Quadrature 


Applicable to One-dimensional definite integrals. 


Yields 
Integration rules on a finite interval using non-uniformly spaced nodes. 


Idea 

A general expression for approximating an integral is proposed. The 
unknown constants in this expression are determined by making the quadra- 
ture rule exact for polynomials of low degree. 


Procedure ; 
Given the integral J = f° g(x) dx we first map it to the interval [—1, 1]; 
this will minimize the algebra later. We have 


r= fo(zyar= "5? fg (Pa Or) a= [seat 


so that we can now focus on I = Es f(t)dt. Now we search for an 
approximate integration rule of the form 


Ix T=) aif(t). (67.1) 
t=1 


Since this integration rule has 2n unknown constants (the weights {a;} 
and the nodes {t;}), we can hope to choose these constants so that the 
integration rule is exact for all polynomials of degree less than or equal to 
2n —1. It turns out this is always possible. 

For example, with n = 2 we have 


1 
[ “f(t)dt x ax f(t) + aaf (ta) 


If this formula is to be exact for polynomials of degree less than or equal 
to 3, then {a),a2} and {é,¢2} must satisfy the simultaneous algebraic 
equations: 
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Table 67. Values used in Gaussian quadrature formulas. 


Number of Valid for polynomials 
terms Nodes {ti} Weights {ai} _up to degree 
2 —0.57735027 = 1 3 

0.57735027 = 1 


3 —0.77459667  0.55555855 5 
0 0.88888889 
0.77459667  0.55555555 

4 —0.86113631 0.34785485 7 


—0.33998104  0.65214515 
0.33998104 0.65214515 
0.86113631 0.34785485 


1 
f(t) =1 = [rdt=2=a1 +00 
-1 
1 
F(t) =t = / tdt = 0 = a,t; + agte 
-1 
: 2 
f=? = / ta dt = a at? + at? 
1 
f@o=8 = / 3 dt = 0 = ayt? + aid. 
-1 
These equations have the unique solution {a,; = a2 = 1, ty = —t2 = 


1/V3 = 0.5773}. Hence, we have the approximation 


1 
/ f(t) dt » f(-0.5773) + (0.5773). 
= 


To obtain Gaussian quadrature formulas for larger values of n, we 
must find the solutions to a large set of nonlinear algebraic equations. The 
results of such a calculation are shown in Table 67. 

Example 
1 


, . 1 
Consider the integral J = oan] / cosxdz = 1. We represent the 
-1 
numerical approximation obtained by using Gaussian quadrature with n 
nodes by J,. Using 2, 3, and 4 nodes we obtain the approximations 


J = Jq = 0.9957702972 
J = J3 = 1.0000365711 
J =~ Jag = 0.9999998148. 
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Notes 
{1] The values of the {t;} in (67.1) turn out to be roots of the Legendre 
polynomial P, (x). These polynomials are defined by the recurrence relation 


(n + 1)Pn41(r) = (2n + 1)2Pp(x) — nPn-1(2) 


with the initial conditions: Po(=) = 1 and P,(z) = x. Then, for example, 
we can calculate P2(z) = $27 — 3. The roots of P,(z) are at g=+1//3~ 
+0.5773. The next Lexendié polynomial! is P3(x) = 559 — $2; its roots are 
at c= 0 and 2 = +,/2 = £0.7746. 

[2] The values of the weights {a;} in (67.1) are also functions of Legendre 
polynomials. If z; is the i-th root of P,(z), then the corresponding weight, 


a;, is given by a; = ——————————.,.. For example, when n = 2 we find 


(1 - 2?) (Pa(zs))’ 


2 . When 2; = +1//3 this results in a; = 1. 


(1 - a; ) (32)? 

[3] See the section on generalized Gaussian quadrature (page 291) for the anal- 
ogous technique applied to integrals of the form I w(x) f(x) dz, when w(z) 
is a positive weighting function. 

[4] Newton-—Cotes rules (see page 319) are also interpolatory, but the nodes are 
chosen to be equidistant from one another. 

[5] Several modifications of the Gaussian principle have been developed, in 
which some of the nodes or weights, or both, are specified in advance. The 
Radeau formulas use one of the endpoints, the Lobatto formulas use both of 
the endpoints. 

The simplest Radeau formula has the form ii f(z) dx = wi f(21) + 
we f(0), for rive unknown {21,w1i,w2}. Making this quadrature rule exact 
for f(z) = x* (for k = 0,1,2) results in the quadrature rule i f(z) dz x 
2 £(3) + 3 £(0). 

[6] The Tschebyscheff weight function w(x) = (1 — 2”)~}/? is the only weight 
function (up to a linear transformation) for which all the weights in a n-point 
Gauss quadrature formula are equal. See Peherstorfer [5] and the section on 
Tschebyscheff rules (page 331). 


a= 
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68. Gaussian Quadrature: 
Generalized 


Applicable to Integrals that have a positive weighting function. 


Yields 
Integration rules using non-uniformly spaced nodes. 


Idea 

A general expression for approximating an integral is suggested. The 
unknown constants in this expression are determined by making the quadra- 
ture rule exact for polynomials of low degree. 


Procedure 
Consider the integral 


b 
rf]= [ w(2)f(a)ae 


where w(x) is a specified positive function. To numerically approximate 
If] for different functions f(x), we choose to use a quadrature rule of the 
form 


I[f] = » wif (xi) (68.1) 


where the weights {w;} and the nodes {z;} are to be determined. These 
values are determined by requiring that (68.1) be exact when f(z) is a 
polynomial of low degree. 

In the section on Gaussian quadrature (page 289) the same formulation 
was used when w(z) = 1 and a and 6 were finite. In that section it was 
shown that the nodes {2;} and the weights {w;} are related to the roots of 
Legendre polynomials. In the more general case considered here, it can be 
shown that the weights {w;} satisfy a polynomial specified by the weight 
function w(x). 

In particular, if the inner product of two functions f and g is defined 
by (f,g) := i w(x) f(x)g(x) dx, and j is any positive integer, then there 
exist 7 polynomials {p; | k = 1,2,...,j} with the k-th polynomial being of 
degree k, such that (px, , pr.) = 0 when k; # ko. Such a set of polynomials 
can be constructed via 


Po(z) a 1, 


. (68.2) 
Pi41(2) = ( — 6:4.1)pi(z) — ¥24,7i-1(z) for i > 0, 
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where p_1(x) = 0 and 


(xpi, Di) . 
6:41 = ———  fori>0, 
i (pi, Di) - 
0 for i = 0, (68.3) 
/ so ee 
Vi+1 = (pi, Di) for i > 1. 
i—1;Pi-1 


We can now state what the values of {w;} and {z;} are. The {z; | 
t = 1,2,...,n} are the roots of the polynomial p,(x) and the {w; | i = 
1,2,...,} are the unique solution of the (nonsingular) linear system of n 
simultaneous equations 


n 
ay. = (po, Po) for k = 0, 
Dpaladrun= { ee ee ee 


The nodes and weights appearing in (68.1) may also be found by 
finding the eigenstructure of a specific matrix. If the tri-diagonal matrix 
J, is defined by 


61 ‘2 0 
72 62 
= 
6n-1 Yn 
0 Yn bn 


then the eigenvalues of J, will be the nodes in the quadrature formula, 
{z;}. Corresponding to each of these eigenvalues is an associated eigen- 


vector, Vv; = (vf, v!), Sas ,ui"))T (so that J,v; = 2;v;). The weights in 
2 

the quadrature formula are then given by w; = (of? ) . See Stoer and 

Bulirsch [3] for details. 


The roots, {z,; | 7 = 1,2,...,n}, turn out to be real, simple, and to lie 
in the interval (a,b). The weights satisfy w; > 0 and the relation 


b n 
[ ee ypla) ae = ¥° wipl) 


i=1 


holds for all polynomials p(x) of degree 2n — 1 or less. For some specific 
weight functions, w(z), and intervals [a,b], the polynomials {p, | k = 
1,2,...,n} turn out to be classical polynomials. For example, we find 
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interval w(x) Orthogonal polynomials 
[-1, 1] (1 — 2?)-1/2 T;,(x), Tschebyscheff polynomials 
[0, co] e-* [,(xz), Laguerre polynomials 
[—co, 00] e7? H,,(z), Hermite polynomials 


In Table 68 may be found a more complete list of orthogonal polynomials. 
That table also describes the corresponding nodes and weights of each 
quadrature rule. 

The error term in such an approximation is given by the following 
theorem. 


Theorem: If f € C?"[a, 6] then 


b n 2n) 
Binl= | w(2)steyae~ Y wise) = FO on.pe) 


i=1 


for some € € (a, 6). 


Table 68. Some specific generalized Gaussian quadrature rules. 


68.1 Gauss’ formula 
Approximation: fi (x) dz = 3 wif (ti) + Rn 


Nodes: 2; is the th root of Pp (x) (Legendre polynomial) 
2 


Weights: w; = ——_-——_——__5 
(1 — xf) (Pa(zs)) 

2"Hint ony 
—_—_—_—————_,, f*” ith -l1<€<1 
QnaDiomp ™ : 
Reference: Abramowitz and Stegun [1], 25.4.29 


Error term: R, = 


68.2 Radeau’s integration formula 
Approximation: i: f(z) dz = * ae 1)+ yw f(zi) + Rn 


Nodes: 2; is the i-th root of Pa1(z) + Pa(z) 


: z+1 
Weights: ws = ————_———_,, 
Cs wi) | ( Ph_4(xi))° 
' _2 es nf(n - 1)!/* (2n-1) . 
Error term: Ry, = Ten-DyP ze Mp f (€) with -1<€<1 


Reference: Abramowitz and Stegun [1], 25.4.31 
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68.3 Lobatto’s integration formula 
Approximation: [ f(x) dz = iG@e= 1) [f(1) + f(-1)] + as (zi) + Rn 
Nodes: 2; is the (i — 1)st root of . as 
eee as 
ape pom) with “16 < 


Reference: Abramowitz and Stegun [1], 25.4.32 


Error term: R, = — 


68.4 Weight function z* 
Approximation: i. a* f(x) dz = yw f(zi) + Rn 


Polynomials: gn(x) = Vk +2n+1 ip (1 — 22) 
Nodes: 2; is the i-th root of gn(zx) 


n-1 
Weights: w; = (= aco) 


j=0 


(k + 2n + 1)(2n)! | (k + 2n)! 
Reference: Abramowitz and Stegun [1], 25.4.33 


(2n) { 1]? 
Error term: Rn = pee Adie 7 | withO<&<1 


68.5 Weight function /1—2 
Approximation: [ f(z)V1—-—2dzr= 3 wif(zi)+ Rn 


t=1 
Nodes: 2; = 1 — €? where €; is the i-th positive root of Pan41(z) 
Weights: w; = 2€?w(?"*”) where {w(?"t”)} are the Gaussian weights of order 
2n+1 


Ry = Pn t ON _pramcgy i 
Error term: Rp = (on)\(4n + 3)[(4n + ae (€) with0<&<1 


Reference: Abramowitz and Stegun [1], 25.4.34 


1 
68.6 Weight function 
6 Vvl—-z 
_f(z)_ 


CEES dz = Yo wsteo + Rn 


Nodes: 2; = 1 — 2 where €; is the “ith positive root of Pon(x) 

Weights: wi = 2w?r) where {wi} are the Gaussian weights of order 2n 
gine (2m) f2M(E) withO<&<1 

4n +1 [(4n)!]? 
Reference: Abramowitz and Stegun [1], 25.4.36 


Approximation: 


Error term: Ry = 
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68.7 Weight function 


1 
V1-=2? 


1 
Approximation: ert c= 3 wif(ti)+ Rn 
Nodes: z; = cos (Qi- x 

* 2n 
Weights: w; = Ps 
Error term: Rp = Gat f?™(€) with -1<& <1 


Reference: Abramowitz and Stegun [1], 25.4.38 
68.8 Weight function /1 — 2? 
Approximation: a f(z)JV1—-22 dz = Ss f(ti) + Rn 


i=1 
(¢+1)7 
N :4= —— 
odes: x; = cos +1 
; : a TV . 2 t+ 1 Tv 
Weights: w; = are sal “a 
Error term: Rn = faa with -—1< E <1 


Reference: Abramowitz and —_ [1], 25.4.40 


68.9 ane function 5 


7 dt= 5 wi fas) + Rn 


t=1 


Approximation: 7 (x) 


Nodes: 2; = cos (2 =o r) 


2n+1 2 
Qn 

2n + Te 

Error term: Ry = 


Weights: w; = 
sagen} withO<&<1 
Reference: Abramowitz and Stegun [1], 25.4.42 


68.10 Weight function e~* 
fore) n 
Approximation: i: e * f(z) dr = > wif (zi) + Rn 
0 


t=1 
Nodes: 2; is the 7-th root of L,(z) (Laguerre polynomial) 
(n!)?2; 
(n + 1)°"Lings(zi) 
(n!)? (2n) : 
Error term: Ry = (anit (€) with 0 <  < co 
Reference: Abramowitz and Stegun [1], 25.4.45 


Weights: w; = 
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68.11 Weight function e7? 
co n 
Approximation: / e* f(z) dz = y wif(zi)+Rn 


—oo 


t=1 
Nodes: 2; is the 7-th root of Hn(z) (Hermite polynomial) 


n-1l_) 
Weights: w; = VE 
n ee 
nlJ/r 
oy ae (2n)(¢) with — 
Error term: Rn (nit (€) with —co < E < 00 


Reference: Abramowitz and Stegun [1], 25.4.46 


Notes 

[1] The technical conditions required on w(z) for the orthogonal polynomials 
to exist are (see Stoer and Bulirsch (3]): 

e w(x) > 0 is measurable on the (finite or infinite) interval {a, 5]; 

e All the moments I z*w(z) dz for k = 0,1,... exist and are finite; 

e If s(z) is a polynomial which is nonnegative on the interval [a, 6], then 
f w(xz)s(x) dz = 0 implies that s(z) is identically zero. 

[2] Press and Teukolsky [2] discuss the numerical development of Gaussian 
quadrature rules when the weight function desired is not one of those in 
Table 68. 

[3] Depending on which polynomials are used to obtain the quadrature rule, 
the rules obtained by this technique are called Gauss—Hermite rules, Gauss- 
Jacobi rules, Gauss—Laguerre rules, Gauss—Legendre rules, etc. 

[4] Frequently, Gaussian integration rules of successively higher order are tried 
when approximating an integral. Unfortunately, it is most often the case 
that information about the function cannot be re-used when using a higher 
order rule; that is, the roots of the polynomials at each order do not overlap. 
See the section on Kronrod rules (page 298) for a solution to this problem. 
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69. Gaussian Quadrature: 
Kronrod’s Extension 


Applicable to One-dimensional definite integrals. 


Yields 
A sequence of integration rules starting with a Gaussian rule. 


Idea 

When an integral is to be evaluated by different Gaussian integration 
rules, none of the values of the integrand, except possibly for the z = 0 
value, can be re-used. It is possible to devise interpolatory rules that re-use 
all of the nodes in a Gaussian rule. 


Procedure 

Consider the integral I = [ id f(z) dz. Suppose the Gaussian n-point 
rule, Gy, is used to approximate J numerically. Later, it may be of interest 
to approximate J numerically using m nodes (with m > n). If the Gaussian 
m-point rule, Gj», is used, then the only values of f that were obtained 
using G, that can be re-used is, possibly, the value s = 0. (The value 
x = 0 can be re-used only if both n and m are odd). If f is an expensive 
function to compute, then it would be useful to re-use many values from 
the G, computation. 

It is possible to start with the nodes from the rule G,, {xz; | i = 
1,2,...,n}, and add new nodes {y; | i = 1,2,...,2 + 1} so that all 
polynomials of degree 3n + 1 are integrated exactly, if n is even (degree 
3n + 2, if nm is odd). The Kronrod rule, which uses the nodes {2;,y;} to 
evaluate polynomials of maximal degree exactly, will be called Kon+1. Note 
that the weights corresponding to the nodes {z;} in Kon41 will not be the 
same as the weights corresponding to the nodes {2;} in Gy. 

As an example, Table 69 shows the rules G7 and Ks. 


Notes 

[1] Piessens et al. [11] contains the numerical values of the nodes and weights 
for the following rules: {G7,Kis}, {Gio, Kai}, {Gis,K3i1}, {Goo, Ka}, 
{Ges, Ksi}, and {G3o, Ker}. 

(2] The technique in this section may be continued; after the n-point Gaussian 
rule (Gn) is used, and the 2n + 1-point Kronrod rule (K2n41) is used, 
additional nodes may be added to interpolate higher order polynomials. 
Nodes and weights for the sequence of rules {G3, K7, Pis, P3i,..., Poss} are 
given in Patterson [8]. (Here, the rule Py is exact for polynomials of degree 
(3k + 1)/2.) 

Similarly, the sequence of rules {Gio, K21, P43, Ps7} is given in Piessens 
et al. [11]. 

[3] Kronrod extensions also exist for Gaussian rules with the weight function 

(1 — 2)" (for -i <p 8). 
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Table 69. Values used in 7-point Gaussian and 15-point Kronrod quadrature 
formulas. The formulas are symmetric, only the positive nodes are shown. (That 
is, if wif(ti) appears, then so does wi f(—t;).) 


Name Nodes Weights 
7-point Gaussian 0.94910 0.12958 
0.74153 0.27970 
0.40584 0.38183 
0 0.41795 
15-point Kronrod 0.94910 0.02293 
0.94910 0.06309 
0.86486 0.10479 
0.74153 0.14065 
0.58608 0.16900 
0.40584 0.19036 
0.20778 0.20443 
0 0.20948 


[4] Instead of using a higher order rule, the same rule can be re-applied with 
a smaller interval size. For even more accuracy, an extrapolation technique 
can be used, see page 249. 

(5) Favati et al. [3] derive a set of symmetric, closed, interpolatory quadra- 
ture formulas on the interval [—1,1] with positive weights and increasing 
precision. These formulas re-use previously computed functional values. 
They obtain a tree of quadrature rules having 74 elements, 27 leaves, and 
a maximum height of 14. That is, the sequence of height 14 is a collection 
of quadrature rules that use (2,3,5, 7,9, 13, 19, 27, 41, 57, 85, 117, 181, 249) 
nodes, and each rule re-uses all the nodes from the previous rule. 

Favati et al. [3] performed extensive numerical tests using their new 
rules in place of the Gauss—Kronrod rules in the routines QAG and QAGS, in 
the computer library Quadpack. For one-dimensional and two-dimensional 
integrals, the resulting programs appear to be faster, more reliable, and to 
require fewer function evaluations. 

[6] Rabinowitz [12] considers the numerical evaluation of integrals of the form 
} wee) dz with w(x) = (1 — 2”)*-1/? for0< p< 2. 

-1 
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70. Lattice Rules 


Applicable to One-dimensional and multidimensional integrals on the 
unit cube. 


Yields 
A numerical approximation scheme. 


Idea 
A lattice rule uses all the nodes on a lattice that lie within and on the 
boundary of the unit cube. 


Procedure 
A lattice rule is a numerical scheme for approximating the value of an 
integral over the multidimensional unit cube. The integral is assumed to 
have the form I = [.,, f(z) dx, where C® is the closed s-dimensional unit 
cube 
CP ={(e1y0404 25) (OS <1) 4=1,2,0.558). 


Every lattice rule can be written in the form 


a JZ Imm 
Is ae oe 7 ( int) (70.1) 


gal jizl 
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where f is the periodic extension of f (see next paragraph), {21,Z2,...,Zm} 
are vectors with integer components, and {n1,72,...,m} are given inte- 
gers called invariants. (It is generally assumed that nj; divides n; for 
t= 1,2) 32590 — 1.) 

Let {x} denote the fractional part of x (e.g., {3.4} = 0.4), and let 
{x} = ({21,22,...,025}) = ({x1}, {z2},...,{zs}). Then the periodic ex- 
tension of f is defined by 


F(x) := f({x}), when {2z;}#0, forall j=1,2,...,8 


Hence, f coincides with f in the interior of the unit cube. At the points 
on the boundary of the unit cube, f is generally not continuous. At these 
points, f is defined by 


f(x1,22,-. »¢@a) 


=s *° lim Eee oD A ets arpa ea -,>Zu + €Ts) 


e—0+ 


with each r; taking only the values +1. If f is continuous on C*, then 
this limit exists and is a symmetrical average of the values of f at corre- 
sponding points on opposite faces of the boundary. For example, in the 
one-dimensional case we find 


F(0) = f(1) = 3(F() + f()). (70.2) 


Sloan and Lyness [8] consider quadrature rules for the s-dimensional 
hypercube of the form 


which cannot be expressed in an analogous form with a single sum. These 
rules are called rank-2 lattice rules. 

If m summations are required to represent the rule, as shown in (70.1), 
then the rule has rank m. The number of nodes used by such a rule is 
Wey n;, and the rule may be expressed in a canonical form with m indepen- 
dent summations. Under this classification, an N-node number-theoretic 
rule (see page 312) is a rank m = 1 rule with {n;} = {N,1,1,---,1}, and 
the product trapezoidal rule (see page 323) using N* nodes is a rank m = s 
rule with {nj} = {N,N,---, N}. 
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Example 


In the case of one dimension, (70.1) becomes (where the single sub- 


script has been suppressed) 


asaiS 7 (# 
ret=2 (FZ), 


Combining this with (70.2) and using z = 1, we are led to the trapezoidal 
rule in the more familiar form 


= vo (§) == FO+ DS (4) + 5f(1) 


The only N-point one-dimensional lattice rule is the trapezoidal rule. 
Notes 


[1] 


[2] 


[3] 


The s-dimensional product-trapezoidal rule is defined by 


tw 2s a9 i ; ( Gisdeasde i) 


ee eae jAi=1 (70.3) 
FfjJiei1 , J2e2 jess 
= EY YT (ees Bee s+ He) 

je=1 J2=1j1=1 
where e; is a unit vector with a one in the z; direction, and zeros elsewhere. 
For the one-dimensional integration of a periodic function, the trapezoidal 
rule is an efficient choice. However, for s-dimensional integration of a 
periodic function over a hypercube, the s-dimensional product trapezoidal 
rule is not generally cost effective. Other lattice rules can be more effective. 
Lattice rules often have many representations. For example, the two-dimen- 
sional product of the 3-point and 4-point trapezoidal rules may be written 
in the two 


rT} Ly 37 (a 0) ue jn On) - L7(s 3: Go) (70.4) 


ji=l jg=1 
Figure 70.a shows this lattice rule. As another example, all of the following 
represent the same rule: 


(1,2 3, “= ( (1,2 
EY DT (ae ane GD) - #7 (5%) 


ji=1jg=1 


Figure 70.b shows this lattice rule. 
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A A 
y | (a) | (b) 
| l 
1 ‘ ae eee C ° Nees fete 2 1 a a arena ce 
i ; $ eee Sone 
| : a (adie Ss 
2 = esceeeoe eC Dit 
; | eee esas @..---- e : { : 
: - a ra ea Seoieag enisas 
1 . 4 3 ss 
| : 5 pike aes aaah? Ce ee te 
0 $a he es ee Le SS 0 iat ee ee, ee 
oO} Fou s obi ta 2 


Figure 70. The nodes appearing in some lattice rules: (a) the lattice rule in 
(70.4); (b) the lattice rule in (70.5). 


[4] 


[5] 


[6] 


[7] 


Sloan and Walsh [10] consider lattice rules of rank 2, i.e., rules of the form 


I= SST (H+ A) 


j2=1j,;=1 


where n > 1 and r > 1. According to a criterion introduced for number- 
theoretic rules (see page 312) they find the “best rules” of the above form. 
Lyness and Sgrevik [4] use a different measure to determine optimal lattices. 
Both papers contain numerical results and identify useful rules. 

Lyness and Sgrevik [3] investigate the number of distinct s-dimensional 
lattice rules that employ precisely N nodes, v.(N). They give many results 
for vs(N) including: 

(A) vs(MN) < ve(M)v.(N), 

(B) Equality holds in (A) if and only if M and N are relatively prime. 


(C) If the prime factorization of L is L = [J Pf , then »,(L) = Il, Vs (3 ) 


where v, (p’) = ne <1) for #> 1 and +30 


For lattice rules of the form — i f ({2 Pt), Haber [1] calculates 


several “good” choices for p of a form p = (1,6,6’,...,6°~?) for various 
values of N and s. Here, goodness is defined by how well the integral rule 
performs on the test function ]]}_, f(x:), with f(x;) =1+7?(2?-2+2). 
Zinterhof [12] presents a fast method for generating lattices that are nearly 
as good as the optimal lattices. The lattices so generated are tested on the 
integrands 
8 
Ai(z1,...,28) = Il (1 — 2log (2 sin xz;)) 


i=1 


Ho(x1,...,2s) = I] (1 as x oF r( = 2(2:)?] 


t=1 
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in C*. These integrands are chosen because their Fourier transforms are 

H,(m) = R(m)~ and H2(m) = R(m)~?, where m = (mi,...,m,) and 

R(m) = |[j_, max (1,|mi|). 

[8] Sloan and Lyness [9] give some of the properties of the projections of rules 
into lower dimensions. 

[9] Worlet [11] introduces some new families of integration lattices. These have 
a better order of convergence that previously known constructions. 

[10] The results in Niederreiter [5] suggest that in the search for efficient lattice 
rules, one should concentrate on lattice rules with large first invariant. 
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71. Monte Carlo Method 


Applicable to Definite integrals, especially multidimensional integrals. 


Yields 
A numerical approximation derived from random numbers. 
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Idea 
Random numbers may be used to approximate the value of a definite 
integral. 


Procedure 1 
Suppose we wish to approximate numerically the value of the definite 
integral 


I= foe) de, (71.1) 


where B is some bounded region. Since B is bounded, it may be enclosed 
in some rectangular parallelepiped R. Let 1g(z) represent the indicator 
function of B, that is 


_ jl ifzseB, 
1a(e)= {4 if x ¢ B. 


Then the integral J may be written in the form 
I= i (o(2)15(2)) de = eee 7 (o(e)te(@)V(R)) de (71.2) 
R V(R) Jr 


where V(R) represents the volume of the region R. Equation (71.2) may be 
interpreted as the expectation of the function h(X) = g(X)1p(X)V(R) of 
the random variable X , which is uniformly distributed in the parallelepiped 
R (ie., it has the density function 1/V(R)). 

The expectation of h(X) can be obtained by simulating random devi- 
ates from X, determining h at these points, and then taking the average of 
the A values. Hence, simulation of the random variable X will lead to an 
approximate numerical value of the integral J. If N trials are taken, then 
the following estimate is obtained: 


N N 
IeTo yD M@= TP Lolelae) (1.9) 


t=1 


where each 2; is uniformly distributed in R. 

Another way to think about (71.3) is that g(&;), where &; is chosen 
uniformly in B, is an independent random variable with expectation I. 
Averaging several of these estimates together, which is what (71.3) does, 
results in an unbiased estimator of I. 
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Procedure 2 
Importance sampling is the term given to sampling from a non-uniform 
distribution so as to minimize the variance of the estimate for J. Consider 
writing (71.1) as 
I = Eylg(2)) (71.4) 


where Ey[-] denotes the expectation taken with respect to the uniform 
distribution on B. In other words, J is the mean of g(x) with respect to 
the uniform distribution. Associated with this mean is a variance, defined 
by 


of, := Ey [(o(2) - 1) = Ey [97] =", (71.5) 


Approximations to J obtained by sampling from the uniform distribution 
will have errors that scale with oy. 
If f(x) represents a different density function to sample from, then we 


may write 
1 [(GB)ma-nlf 


where E-[-] denotes the expectation taken with respect to the density f(z). 
In other words, J is the mean of g(x)/f(x) with respect to the distribution 
f(z). Associated with this mean is a variance; defined by 


2:= g(t) _ 7\\ _ V7) _ p_[¢@,_p 
opm 8, ({96) 1}') =2, [| I= oT) I 


Approximations to J obtained by sampling from f(a) will have errors that 
scale with oy. 

A minimum variance estimator may be obtained by finding the f(z) 
such that oF is minimal. Using the calculus of variations the density 
function for the minimal estimator is determined to be 


fop(2) = Clot) = 7 eer ae (71.6) 


where the constant C has been chosen so that fopt(x) is appropriately 
normalized. (Since fopt(z) is a density function, it must integrate to 
unity.) Clearly, finding fope(z) is as difficult as determining the original 
integral I! However, (71.6) indicates that fopt(x) should have the same 
general behavior as |g(z)|. As Example 2 shows, sometimes an approximate 
f(x) © fopt(z) can be chosen. 
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Procedure 3 

Another type of Monte Carlo method is the hit-or-miss Monte Carlo 
method (see Hammersley and Handscomb [6]). It is very inefficient but 
is very easy to understand; it was the first application of Monte Carlo 
methods. Suppose that 0 < f(z) < 1 when 0 < z < 1. If we define 


_ [0 iff(a)<y, 
oem {tifa So 


then we may write J = i f(z)dz= So i g(x, y) dy dx. This integral may 
be estimated by 


2 


n 
Te Pet) o(s-1.60) => (71.7) 
rar n 

where the {&;} are chosen independently and uniformly from the interval 
(0,1). The summation in (71.7) counts the number of points in the unit 
square which are below the curve y = f(z) (this defines n*), and divides 
by the total number of sample points (i.e., n). We emphasize again that 
the hit-or-miss method is computationally very inefficient. 


Example 1 
We choose to approximate the integral J = ifs 3x? dr, whose value is 1. 
To implement the method in (71.3), 


N 
- 1 ‘ Sai 
IvI= W > 32?, for x; uniformly distributed on (0, 1] 


t=1 


the FORTRAN program in Program 71 was constructed. The program 
takes the results of many trials and averages these values together. Note 
that the program uses a routine called RANDOM, whose source code is not 
shown, which returns a random value uniformly distributed on the interval 
from zero to one. 

The result of the program is as follows: 


AFTER 100 TRIALS, THE AVERAGE IS 1.006 
AFTER 200 TRIALS, THE AVERAGE IS 1.084 
AFTER 300 TRIALS, THE AVERAGE IS 1.046 
AFTER 400 TRIALS, THE AVERAGE IS 1.033 
AFTER 500 TRIALS, THE AVERAGE IS 0.996 
AFTER 600 TRIALS, THE AVERAGE IS 1.028 
AFTER 700 TRIALS, THE AVERAGE IS 1.035 
AFTER 800 TRIALS, THE AVERAGE IS 1.029 
AFTER 900 TRIALS, THE AVERAGE IS 1.032 
AFTER 1000 TRIALS, THE AVERAGE IS 1.038 


We can also approximate J by using hit-or-miss Monte Carlo. (First, 
we scale the integrand by a factor of 3, to be f,(x) = x”, so that it is in the 
range [0, 1].) Now random deviates z; and y; (both obtained uniformly from 
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Figure 71. The 323 points (out of 1000) below the curve y = 2”. 


the interval (0, 1]) are obtained. For each pair o values, n is incremented by 
one. If, for that pair of values, y; < f,(2zi) = x?, then n* is also incremented 
by one. Use of (71.7) then results in an estimate for I. 

Performing this algorithm 1000 times, we obtained 323 instances when 
the y; was less than y? (Figure 71 shows the locations of these points). 
Hence, the estimate of J becomes 


N 
1 

230} ips: . 323 = 0.969. 
rp» B(ti) = an 


Example 2 
Consider the integral 


r= [cos (3) ae =?. 


If we let €; represent a sample from the uniform distribution from (0, 1] 
then J may be approximated by Jy 


JzJy= i oon te mei 


The variance of this estimator for J is 
1 
Nx 1 4 
of, = [ cos” (=) dx — J? = a ay ~ .0947.... 


Now we want to obtain a density function that more closely approxi- 


NZ n 
mates the integrand. Since cos (=) =1- rea + O(zx*) for small values 


of xz, we choose a f(z) that has a similar form. We take 


f(z) =C(1—2?) = 3(1- 27). (71.8) 
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(The factor 3 arises from the normalization fa —2x?)dzx = 2.) Using this 
new density function we find (see the Notes for how to generate deviates 
from this distribution) 


2 cos ( 
J= [ 31a f(z) dz. (71.9) 


If we let ¢; represent a random variable coming from a distribution that has 
the density f(x), then (71.9) may be sampled to yield an approximation 
to J: 


Inte 1 N 2 cos 
~ TONS 31-C° 


The variance of this second estimator for J is 
2 
1 { 9 cos (=) 
o3= | =—4* | f(x)dx -— J? ~ 00099... 
0 _ 


Since oy is approximately 10 times larger than of, the errors in using 
J to approximate J will be about 10 times smaller than using Jy to 
approximate J, for the same number of trials. Of course, in practical cases 
it will not generally be possible to exactly determine the variances oy and 
os. However, estimates can be obtained for the variances by approximating 
the defining integrals. 


Program 71 


SUM=0 

DO 10 J=1,1000 

X=RANDOM(T) 

VAL=3 . *X#*2 

SUM=SUM+VAL 

IF( MOD(J,100) .NE. 0 ) GOTO 10 

AVERAG=SUM/FLOAT (J) 

WRITE(6,5) J,AVERAG 
5 FORMAT(’? AFTER’,I6, ’? TRIALS, THE AVERAGE IS’ ,F7.3) 
10 CONTINUE 

END 
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Notes 

{1] This method is of particular importance when multi-dimensional integrals 
are to be approximated numerically. For multi-dimensional integrals, Monte 
Carlo techniques may be the only techniques that will obtain an estimate 
in a reasonable amount of computer time. This is because the error in a 
Monte Carlo computation scales with o/ VN, where N is the number of 
samples of the integrand (trials), independent of dimension. For traditional 
methods, the number of samples of the integrand varies exponentially with 
the dimension (i.e., scales as a for some a). 

[2] While the classical Monte Carlo method converges with order 1//N, where 
N is the number of samples, the quasi-Monte Carlo method can achieve 
an order of (log N)*/N for some a > 0. See Niederreiter (10]-[11] and 
Wozniakowski’s method on page 333. 

[3] For some integrals, the variance in (71.5) may not exist. For example, with 
I= Use dz/./z, the variance is computed to be of, = i dx/x — I”, and the 
first term is infinite. Use of importance sampling can result in a new integral 
that has a finite variance. See Kalos and Whitlock [7]. 

[4] Masry and Cambanis [8] discuss how the trapezoidal rule can be used in the 
Monte Carlo computation of the integral J = i f(z) dz. Choose n random 
deviates independently and uniformly on the interval [0,1]. Numerically 
order these deviates to form the sequence tn, < tn,2 << +++ < tnyn, and then 
add the points tno := 0 and tnyny1 := 1. The sequence of {tn,i}, used in 
the trapezoidal rule, produces an estimate of I: 


n 

1 

TeIn=5 » Ks + Fltmso) (tn,i+1 — tn,i)- 
= 

If f has a continuous second derivative on the interval [0,1], then it can be 

shown that 


— [f'@-F'@]? +00) 
BUI - I)’ = 4(n + 1)(n + 2)(n + 3)(n + 4) 


Hence, the error varies as O (n~*) for large n. 


(5) The integral J = [> g(x) dz may be written as I = f° 3 (g(x) + g(1— 2) dz. 
Hence, the estimator 


N 
= = > > (ate. +g9(1—- x) ; (71.10) 
= 

where the z; are chosen from the uniform distribution, can be used to 
approximate J. When g(z) is linear, this approximator gives the exact 
answer. (See Siegel and O’Brien [15] for techniques that are exact for other 
polynomials.) In cases where the function is nearly linear, the variance can 
be substantially reduced. This is known as the method of antithetic variates. 
For example, consider the integral I = f, e*dx = e—1. Using a 
straightforward Monte Carlo evaluation the variance is found to be o? = 
So le? - (e- DP? dx = (3 — e)(e — 1)/2 ~ 0.242... Using (71.10) reduces 

the variance to 0.0039, a substantial reduction. 


71. 


[6] 


[7] 


[8] 


[9] 


[10] 
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Error estimates are available for many different approximation schemes (see 
Cambanis and Masry [2]). Consider the mtegral I(g) = in g(t) dt, and 
let each U, below represent an independent random variable, uniformly 
distributed over the interval (0, 1]. 


For the approximation I(g) + I1(g) = ~ ae g(U;), the mean-square 


error is given by: E£ [(7(g) — Ih(g))?] = [7(9?) — I?(g)| /n. 
In the stratified sampling scheme the interval (0, 1] is partitioned into n 
subintervals of equal length and the point U,,,; is chosen uniformly in the i-th 


interval. For the approximation I(g) ~ J2(g) = ot g(Un,i), the mean- 
square error is given by: lim n°E [(I(g) — J2(g))"] = 4 if [g’(t)}? dt. (See 
n—-oo 


also Press and Farrar (13].) 

In the stratified and symmetrized scheme the interval (0, 1] is partitioned 
into n subintervals of equal length and the point U,,; is chosen uniformly 
in the i-th interval. Let U;,,; represent the symmetrically opposite point to 
Un, in the 7-th interval. If g has a continuous second derivative, then for 
the approximation I(g) + I3(g) = = ee [9(Un,i) + 9(U;,)], the mean- 
square error is given by: lim (2n)°E [(7(9) - I3(g))?] =2Z ie [9’"(t)]° dt. 
There are many other variance reduction techniques that are sometimes 
used in Monte Carlo calculations. These include the use of (see Hammers- 
ley and Handscomb {6]): control variates, regression methods, orthonormal 
functions, and group sampling. 

Suppose that J = f f(x) dz is approximated by a Monte Carlo computation. 
Suppose also that the integrals of some “reference functions” (functions 
which can be analytically integrated) are also approximated using the same 
set of Monte Carlo points. Then the accuracy of the estimate of J can be 
improved by using the estimated integrals of the reference functions. See 
Eberhard and Schneider [5] for details. 

Ogata [12] investigates the two test integrals: h {ie : a * eTet2 eT dx 
and | ae 1 eee ve Sees e~X BX" dx where B is a specific Toeplitz matrix. 
Details on how to simulate a random variable from different distributions 
may be found in Devroye [3]. For example, random deviates from the density 
in (71.8), f(z) = 3(1 — 2”) for x in the range [0,1], may be obtained as 
follows: 


e Generate , and &2 independently and uniformly on the interval (0, 1). 


e Iffa < §1(3 ~ €1) my , then z = 1 — €;; otherwise, z = § (V9 — 8&2 — 1). 
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72. Number Theoretic Methods 


Applicable to Definite integrals, especially multidimensional integrals. 


Yields 
Quadrature rules. 


Idea 
Using points from a deterministic sequence might be useful when 
numerically approximating an integral. 
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Procedure 
There are two procedures in this section, both for the simple numerical 
integration rule 


i 
[ teodxe = YF). (72.1) 
The question is: how are the nodes {x;} to be determined? In the first 
method, a different set of nodes is chosen for each value of N; for the second 
method, the first N nodes from an infinitely long sequence are chosen. 
For both methods we will use the notation {z} to denote the fractional 
part of z. For example, {7} = 0.14159... 


Procedure 1 
In the general d-dimensional case of interest, we would like to use a 
formula of the form 


[- [toaxt > 9 {AB} {P) (72.2) 


kg=1 


for some integer values {6;}, which are relatively prime to N. What are 
“good” values of {6;}? 

The usual definition for a good set of values base the decision on an 
error bound obtained by using (72.2) in (72.1). With this definition, there 
are several theorems (see Stroud [5]) on how to determine “optimal” values 
for the {0@;}, when N is a prime number or the product of two prime 
numbers. For some values of N, there is a constant ay such that the 
values 6, = 1 and 6; = aly yield an “optimal” vector. 

Stroud [5] includes several tables of values. We have, for example, the 
following recommended values: 


— for d = 3: 

e for N = 101, {0;} = {1, 40, 85} 

e for N = 1069, {0;} = {1, 136, 323} 

e for N = 10007, {6;} = {1, 544, 5733} 

e for N = 100063 = 47 - 2129, {6;} = {1, 53584, 37334} 
— ford = 4: 

e for N = 307, {0;} = {1, 42, 229, 101} 

e for N = 1069, {0;} = {1, 71, 765, 865} 

e for N = 10007, {6;} = {1, 1784, 430, 6588} 

e for N = 100063 = 47 - 2129, {6;} = {1, 92313, 24700, 95582} 
— ford=5: 

e for N = 1069, {0;} = {1, 63, 762, 970, 177} 

e for N = 10007, {6;} = {1, 198, 9183, 6967, 8507} 

e for N = 100063 = 47 - 2129, {0;} = {1, 90036, 77477, 27253, 6222} 
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Procedure 2 
A deterministic sequence of points {2;,22,...} in the interval [a, }] is 
said to be equidistributed, or uniformly distributed on the interval [a, 6], if 


b 
tin <2 se) = [ serae 


t=1 


for all bounded Riemann integrable functions f(z). 

It is not difficult to construct uniformly distributed sequences. For 
example, if ¢ is an irrational number, then z, = {n¢} is a uniformly 
distributed sequence. These sequences, when used in a simple quadra- 
ture formula, have very good error estimates. For example, Davis and 
Rabinowitz [2] (page 400) have the estimate 


Theorem: Let f(z) be periodic in i 1] and be of class 
C%[0,1] so that we have f(0) = f(1), f’(0) = f'(1), and 
f" (0) = f"(1). Let ¢ be a quadratic irrational number. Then 


Lysine) - f° saree <£ 
ier 0 7 


for some constant c. 


Multi-dimensional uniformly distributed sequences can also be con- 
structed. Suppose that ¢€), C2, ..., Cg are irrational numbers that are 
linearly independent over the rational numbers. (That is, 1+@1¢;+ a@e¢2+ 

.., taqCa # 0 for any rational numbers {a;}.) Then the d-dimensional 
nodes 


= ( {41}, {@},----(60) 


are equidistributed over the hypercube 0 < 2; < 1,i=1,2,...,d. (That is, 
jim Die SCF) = i ves f- f(x) dx for any bounded Riemann-integrable 
function f(x).) 

Example 


Using the values 
013 ~ uy nodes is: { 


j 
(3 
(zor 


<i 40 37 ig » (rors a ; 
TOT’ oe 3 a ee ’ 101 
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Notes 


[1] 


[2] 


[3] 


[4] 
[5] 


Using the first method, the number of nodes at which the integrals are to 
be evaluated grows very quickly. For example, for the (relatively) modest 
values of N = 100063 and d = 3, there are 10'° nodes required! 

Davis and Rabinowitz [2] give an example of the numerical evaluation of 
a 4-dimensional integral in which the irrational numbers chosen were: V2, 
V3, 3V6, and V10. 

There is an common criterion by which a “best rule” may be determined 
(see Sloan and Walsh [7]). Let m be a fixed even positive integer (i.e., 
m. = 2) and then define the function fm(x) = ¢m(£1)¢m(Z2)...¢m(Zn), on 


R” where - 
m/2 (27) Br(z) 
m! : 


om(z) = 1-(-1) 


Here, B,,(x) is a Bernoulli polynomial of degree m. 

Among all quadrature rules Q; on the n-dimensional unit hypercube, 
the “best” one is the one that minimizes Q;[fm] — f fm = Qilfm] — 1. 
In Wozniakowski’s method (page 333), a different infinite sequence of values 
is used. 
The number theoretic methods are generalized in the lattice rules, see 
page 300. 
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73. Parallel Computer Methods 


Applicable to Definite integrals. 
Yields 


Ways in which a parallel computer may be used. 


Idea 


Parallel computers can sometimes speed up the numerical computation 


of an integral. 
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Procedure 

There are many procedures that can be used, depending on the type of 
parallel computer under consideration. The most common use of a parallel 
computer is to partition an integration interval into many sub-intervals, 
and have the integration on each sub-interval performed in parallel. 


Notes 

[1] Genz [2] studied the implementation of a globally adaptive algorithm for 
single integrals on a SIMD computer. 

{[2] Rice [6] considers algorithms for single one-dimensional integrals on a MIMD 
computer. 

[3] Burrage [1] considers a single one-dimensional integral being evaluated on 
a linear chain of transputers of arbitrary length. (A transputer is a local 
memory MIMD computer.) For some classes of problems, numerical ev- 
idence suggests that linear speed-ups are achievable with any number of 
transputers. 

[4] Monte Carlo methods (see page 304) are generally the easiest to implement 
on parallel machines. While these methods are robust, they are generally 
the least efficient. 
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74. Polyhedral Symmetry Rules 


Applicable to Multidimensional integrals. 


Yields 
A numerical quadrature scheme. 


Idea 
Some quadrature rules are invariant under a symmetry group operating 
on the nodes. 
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Procedure 
Consider the construction of a quadrature rule of the form 


N 
I w(x) f(x) dx = S| wef (xk), (74.1) 
B k=1 


where w(x) is a specific weight function. Generally, it is required that a 
quadrature rule be exact for all polynomials below some degree. Forcing 
(74.1) to be exact for low degree polynomials results in a large system of 
nonlinear algebraic equations that must be solved for the nodes {x,}, the 
weights {w,}, or both. 

To reduce the number of equations, we can impose full polyhedral 
symmetry on the formula. This may result in a formula that is not of the 
highest order, but it sometimes allows a formula to be quickly developed. 


Example 
Consider devising a 4-node quadrature rule on the square: 


1 1 4 
/ a. Fo (x,y) dz dy =) wif (ais 4). (74.2) 
- = t=1 


To completely specify the quadrature rule we require 12 values, {w;, xi, yi | 
i=1,...,4}. To force (74.2) to be exact for all polynomials of degree 0, 1, 
and 2, the unknowns must satisfy 


f(z,y) =1: Wiy+twetuzgtw, =4 

f(z,y) =a: W121 + Were + w3r3 + war, =0 

F(z,y) =y: Wiy1 + Woy2 + w3y3 + Ways =0 (74.3) 
f(z,y) =2?: w1 2} + werk + w3x3 + wazz = 3 
f(x,y) =y": wy? + woys + wsy3 + wayZ = 4 

f(x,y) = zy: W1T1y1 + Wot2y2 + W3r3y3 + Watays = 0. 


Solving these nonlinear algebraic equations is a non-trivial task. Even 
determining the number of solutions to these equations is difficult. 

Suppose, however, that we require the quadrature formula to be sym- 
metric under rotation. That is, whenever the node (2;, y;) is in (74.2), then 
the nodes (—2;, y:), (ai, —y;), and (—z;, —y;) should also be in (74.2). This 
constraint adds the following restrictions to (74.3): w, = we = w3 = wa, 
Ly = £2 = —£3 = —T4, and y; = —y2 = —y3 = ys. With these constraints, 
the equations in (74.3) become: 
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F(z,y) =1: 4w, =4 
f(x,y) =f: 0 =0 
f(z, y) =y: 0-0 
f(z,y) = 2?: 4wi2? = 4 (74.4) 
f(z,y) =y?: 4ury? = 4 
f(z,y) = ry: = 0. 


The equations in (74.4) can be readily solved to determine that w,; = 1 and 
2 =, = 1/V3. 


Notes 

{1] The quadrature rule found in the example is also exact for polynomials of 
degree 3 (i.e., the rules are exact for the functions f(x,y) = z°, f(z,y) = 
a?y, f(x,y) = xy’, and f(x,y) = y°). 

[2] The groups under which the nodes are mapped into themselves are the 
reflection groups of polyhedra. In three dimensions there only exist three 
such groups: 


(A) the extended tetrahedral group of order 24 (the orbits of this group can 
have 24, 12, 6, 4, or 1 point(s)); 

(B) the extended octahedral group of order 48 (the orbits of this group can 
have 48, 24, 12, 8, 6, or 1 point(s)); 

(C) the extended icosahedral group of order 120 (the orbits of this group 
can have 120, 60, 30, 20, 12, or 1 point(s)). 

[3] Cools and Haegemans (3] consider quadrature formulas that are invariant 
with respect to a transformation group and prove sufficient conditions for 
such formulas to have positive weights. 
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75. Polynomial Interpolation 


Applicable to Definite integrals. 


Yields 
Integration rules on a finite interval using uniformly spaced nodes. 


Idea 

When values of a function at a discrete set of points are known, an 
interpolating polynomial can be passed through those points. The integral 
' of the original function will approximate the integral of the interpolating 
polynomial. 


Procedure 

Given the interval [a, 6], discretize it into n segments of equal length 
by inserting the n + 1 nodes: {z,; | z; = a+ih,t = 0,1,...,n} where 
h = (b—a)/n. If the function f(z) is known at the n + 1 nodes (i.e., 
f; = f(ai)), then the interpolatory polynomial P, (x), of degree n or less, 
that goes through all n+1 pairs (2;, f;) is given by Lagrange’s interpolation 


formula a a 
_ |. _ L—- LE, 
Pr (2) = 2, fili(z), L;(z) = II t; — Dk 
#=0 k#i 
(since L;(x;) = 6:3, where 6;; is the Kronecker delta). Writing z = a + th, 
n 
and using x; = a-+ih, this can be written as L;(z) = K;(t) = I] —. 
k=0 
kHi 
Integrating P,(x) from z = a to x = b leads to 
b n b 
[ Patayar= Kf Lileyae 
a i=0 a 
n n 
=h>- fi | K;(t) dt (75.1) 
0 


i=0 


= n> wifi 


i=0 
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Table 75.1. Newton—Cotes rules obtained from polynomial interpolation. 


n Wi Error Name 

1 $¢ 3 he f (€) trapezoidal rule 

2 i: 4 3 Ae f(€) Simpson’s rule 

3 2 2 2 3 he 3 f)(€)  Simpson’s 3/8-rule 
4 4B 4 & h? 38. (9) (e) Milne’s rule* 

5 yes 3a8 388 388 268 268 bh eee FE) = 

6 dL us 27 22 ar 2s Saf (E) ~~ Weddle’s rule 


where w; = f,' K;(t)dt. Since the {w;} do not depend on the function 
f(x), they can be pre-computed. For example, for n = 2 we find: 


2 2 
= t-1\/t-2\, 1 nae _1 
w= | (=) (7) a=5 (t 3t+2) dt= 3 
2/t-0\ (t-2 er 4 
w= f (5) (75) a--f (¢ — 2t) dt= 3 
2/t-0\ (t-1 a ee 1 
w= f (55) (S=+) a= 5 [ (-) a= 5. 


This gives rise to the integration rule: 


b b h 
[ saace [ Pr(e)de = 5 (fot 4h +f) 


where h = (b—a)/2 and f, = f(a+kh). This is known as Simpson’s rule. 
The error in using the integration rules in (75.1) can be shown to be 
given by 


b b 
/ Bae ii f(x) dx = hP-*1E,, flP™)(e) 


for some & € (a,b) where p, and E,, are functions of n and not of f(z). 

The approximations given in (75.1) are known as the Newton-Cotes 
rules. Some tabulated values of the {w;}, as well as the corresponding error 
term, are presented in Table 75.1. As indicated in that table, some of the 
Newton-Cotes rules also have other names. 


* Also known as Boole’s rule. 
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Table 75.2. Open Newton-Cotes rules obtained from polynomial interpolation. 


n Wi Error Name 

o- 2 32 fe) midpoint rule 
3 3 g h33 FE) = 

4 §-$ 8 mF) 

ee ee Cn 

6 HBR -2H BIO 

Example ? 
Consider the integral J = = iN coszrdz = 1. Define [, to be 


0 
the result of using the n-node rule from Table 75.1. Then we obtain the 
following approximations to I: 


I = Ig = 0.1063722664 
I = Iz = 1.0379687263 
I = Ig = 1.0163528101 
I = Is = 0.9994771775 
I = Ig = 0.9997082294 
I x I; = 1.0000059300. 


Notes 


[1] 


[2] 


[3] 


Newton-—Cotes rules for large values of n are not often used since some of 
the weights {w;} become negative and numerical cancellation occurs in the 
computation. 

In the above we discretized the interval [a,b] into n + 1 nodes that included 
the endpoints a and 6. Hence, the above formulas are sometimes called 
closed Newton-Cotes rules. 

If we only consider the interior nodes, {x; | 3 = at+th,t = 1,...,n—1} 
(where, as before, h = (b — a)/n), and then approximate the given integral 
by the integral of the interpolating polynomial, then we will have derived 
on open formula. These formulas are sometimes called open Newton—Cotes 
rules. The first few such formulas are in Table 75.2. 

Instead of just interpolating the value of f(z) at the nodes {2;}, the values 
of f(z) and f’(z) may be used. For example, if values for the derivatives at 
the endpoints of the interval are given, then the approximate formula 


b 2 
[ seaen 2alt) = F100) + 104 5 (F@-F£'0) 


322 VI Numerical Methods: Techniques 


may be used (here, h = (6 — a)). It can be shown that the error is given by 


6 5 
zath)- [sede = Fog) 


with € € (a,b). See page 287. 

[4] Gaussian quadrature rules (see page 289) are also interpolatory, but the 
nodes are not equidistant from one another. Instead, the node locations are 
chosen to make the rule have as high a degree as possible. 

(5) Sometimes a quadrature formula is desired that integrates trigonometric 
polynomials, not ordinary polynomials, exactly. A trigonometric polynomial 
of degree m is a linear combination of the functions {1,cosz, sinz, cos? z, 
coszsinz, sin? z, ..., cos” z, cos™—'azsinz, ...sin™z}. Equivalently, a 
trigonometric polynomial of degree m is a linear combination of the functions 
{1, cosa, sin z, cos 22, sin 2z, ...cosmz, sinmz}. The approximation 


Qn n 
[sears Saree ea) 
0 


k=1 


where h = 27/n and @ is any real number satisfying 0 < 6 < h, is exact for 
all trigonometric polynomials of degree n — 1 or less (see Mysovskikh [5}). 

Vanden Berghe et al. [7] consider quadrature rules that exactly inte- 
grate ordinary polynomials and trigonometric polynomials. 

{6] Given data values defined on a set of nodes, one polynomial can be fit to all 
of the data values, as shown above. Alternatively, the region of integration 
may be broken into smaller regions, with an interpolatory polynomial fit to 
the data values in each sub-region. Kohler [3] considers the case when the 
interpolatory polynomial on a sub-region uses data values from outside that 
sub-region. 

[7] There are many interpolatory formulas, other than polynomials, that can be 
used to interpolate data. For example, De Meyer et al. [4] interpolate a set of 
values using the function f(x) = e** )-"_, aix’. This interpolating function 
can then be integrated to obtain, for example, their modified trapezoidal 
rule: 


roth a a -6 
[Or tenes nf = pea) + Seo tm}, 


where @ = hk and k is an arbitrary parameter. This parameter is chosen 


in practice, by minimizing the error term. For the above rule, the leading 
_ 4 sinh” (0/2) 5 
order error term has the form E = ro 1— — (Dz — k)* f(n), 


where 7 is in the range tp <9 < Zo th. 
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76. Product Rules 


Applicable to Multidimensional integrals. 


Yields 
A numerical quadrature scheme. 


Idea 

Suppose two numerical quadrature schemes are known, one for r- 
dimensional Euclidean space and one for s-dimensional Euclidean space. 
The “product” of these two rules can be used to formulate a numerical 
quadrature scheme for (r + s)-dimensional Euclidean space. 


Procedure 
Let R (S) be a region in r-dimensional (s-dimensional) Euclidean 
space. Suppose we have the n-node and m-node quadrature rules 


[ teen Y us), 


j=l 


™ 
| g(y) dy =~ >> vg(y,)- 
s k=1 
Then an (n + m)-node quadrature rule for the region B = R x S, in an 
(r + s)-dimensional space, is given by 


i h(x, y) dxdy ~ ye > wjugh(x;, yx). (76.2) 


j=l k=1 


(76.1.a—b) 
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Example 
On the interval [a,b], Simpson’s rule with three nodes approximates 
an integral by 


b 
/ f(a)de ~ = (fo+ 4h + fr) (76.3) 


where f, = f(a + nh) and h = (b—a)/2. Likewise, on the interval [c, d], 
Simpson’s rule with five nodes approximates an integral by 


d 
k 
/ g(y) dy = 3 (go + 491 + 292 + 493 + ga) (76.4) 
c 


where gm = g(c + mk) and k = (d—c)/4. 
Taking the product of the rules in (76.3) and (76.4) results in the 
following approximation of a two-dimensional integral 


b pd 
hk 
‘] | h(x, y) dx dy = > (Ao,o + 4ho,1 + 2ho,2 + 4ho,3 + ho,4 
a c 


+ 4hio + 16h11 + 8hi.2 + 16h1,3 + Ahi 
+ hoo + 4ho1 + 2he2 + 4he,3 + hoa) 


where ham = h(a +nh,c + mk). 


Notes 

[1] If (76.1.a) exactly integrates f(x), and if (76.1.b) exactly integrates g(y), 
and h(x, y) = f(x)g(y), then (76.2) will exactly integrate h(x, y). 

[2] This technique can be used for general Cartesian product regions, not just 
parallelpipeds; for instance, circular cylinders, circular cylindrical shell, and 
triangular prisms. 

{3] Stroud [3] analyzes product rules by use of transformations. Suppose the 
region of integration is S, and the integrals of interest have the weight 
function w(x). If the quadrature rule is to be exact for polynomials, then 
I= ff--- f w(x) xf! 23? ...28" dx must be integrated exactly for some set 

s 


of {a;}. If there exists a transformation of the form x = x(u) that turns I 
into the product J = (f wW3 (t1) gi (z1) du;) ve (f Wn (tn) gn(tin) dun) , and if 
suitable formulas are known for these single integrals, then one has obtained 
a product rule. 

[4] Using product rules, the number of nodes at which the integrand must be 
evaluated grows exponentially with the dimension of the integration. If 
a one-dimensional quadrature rule that uses 19 nodes is the basis for a 
7-dimensional quadrature rule, then 19’ ~ 10° integrand evaluations are 
required. 

[5] The rules devised by this technique are often not the most efficient in terms 
of number of integrand evaluations. 
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[6] 


[7] 


Often, a more computationally efficient quadrature rule for a multidimen- 
sional integral can be found. For example, Acharya and Mohapatra [1] give 
the two-dimensional quadrature rule for analytic functions: 


zoth pzoth' 
f(z, z') dzdz' = hh’ | — 256 foo + 25 (fir + fia + far + fas) 


zo—h zo—h! 
+ 40 (feo + fo2 + fao + fos) 


(76.5) 

where fag = f(2a,28)) Za = 20 + hki®—', and z4 = zo + h’ki?-'. When 
k = 1/15, the rule in (76.5) has degree of precision 5. 
A quadrature rule for the n-cube C, can sometimes be used as the basis 
for a quadrature rule for C,, (with m > n). The rule for C,, is then called 
an extended rule. Product methods, described in this section, are only one 
way in which a rule can be extended. For other methods, see Stroud [3] 
(Chapter 4). 
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77. Recurrence Relations 


Applicable to Integrals for which a recurrence relation can be found. 


Yields 


An asymptotic approximation, or a numerical computation scheme. 


Idea 


If a recurrence relation can be found for an integral, then it may be 


used to determine an asymptotic approximation, or it can form the basis 
of a numerical computation. 
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Procedure 

Often, an integral can be written in terms of a recurrence relation and 
some initial (or boundary) condition(s). (This is frequently accomplished 
by integration by parts.) This recurrence relation can be used to obtain 
asymptotic information about the integral. 

Or, the recurrence relation can be iteratively applied to determine 
numerical values for the integral. These numerical computations should 
only be performed after an asymptotic analysis has been performed, to 
prevent roundoff errors from ruining the numerical accuracy. 

Consider the three term recurrence relation 


Yn+1 + Ann + bnYn-1 = 0, n= 1, 2, eeeg (77.1) 


where {a,,} and {b,} are given sequences of real or complex numbers, and 
b, # 0. From Van der Laan and Temme [6] we have the following theorem: 


Let ay and b, have the asymptotic behavior 
an ~an®, ba~bn?® as n—- 00 (77.2) 


with ab # 0 and both of a and £ real. Let ¢; and te be 
roots of the characteristic polynomial t? + at + b = 0, with 
|ti| > |t2|. Then there are three cases: 
(1) If a > $6 then (77.1) has two linearly independent 
solutions uy, and v, for which 


_ 0 p-a 


Un+1 we—=enk Un+1 ee a 
] 


as nN — 00. (77.3) 
Un Un 


(2) If a = 46 then (77.1) has two linearly independent 
solutions un and v, for which 


Un+1 


Un+l 
anti ~ tn, 


~ton® as n—-0o (77.4) 
Un n 


provided that |t:| > |t2|. If |t1| = |t2| then 
Jim sup (lyn! (n!)~*)/" = Ital (77.5) 


for all non-trivial solutions of (77.1). 
(3) Ifa < $A then 


: = 1 
‘imm_sup (Iya (n!)“#/) "= py? (77.8) 


for all non-trivial solutions of (77.1). 


The solution of the recurrence relation in (77.1) can be written in the 
form y, = Au, + Bu,, where A and B are constants. 
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Table 77.1. A recursion computation of the Bessel functions {Y,,} using (77.7). 
This computation is stable. 


yn} Yn(5) 
yi = 0.1478631434 Yi(5) = 0.1478631434 
yo = 0.3676628826 Yo(5) = 0.3676628826 
ys = —0.4536948225 Y5(5) = —0.4536948225 
yio = —25.129110 Yi0(5) = —25.129110 
yi2 = —382.9821416 Y2(5) = —382.9821416 
yia4 = —8693.938814 Yi4(5) = —8693.938814 
yis = —272949.0350 Yie(5) = —272949.0350 
y20 = —593396529.7 Y20(5) = —593396529.7 
yso = —4.028568418 x 108 Y30(5) = —4.028568418 x 1028 
Example 


The Bessel functions Y,,(z), when n is an integer, are defined by (see 
page 174): 


sd 00 
Y,(z) = =f sin(z sin 6 — n@) d@ — =f [ent + (—1)"e-*] e~= 8iBE de, 


From this, or otherwise (see Abramowitz and Stegun [1] 9.1.27.a), it can 
be shown that these Bessel functions satisfy the recurrence relation (using 


Yn = Y,(z)) 
2n 
Ynt1 — Yn + Yn-1 = 0. (77.7) 


The above theorem can be used on this recurrence relation with a = —2/z, 
a=1,b= 1, and § = 0. We find that case (1) applies and results in 
Un41/Un v 2n/z and Un41/Un ~ 2/2n. This implies that 


Yn(z)~ A (7) +B(=)", 


as n — oo, for some values of A and B. Note that if A # 0, then the first 
term dominates the asymptotic expansion. 

It can be shown that Y,(z) ~ n!(2/z)” as n — oo (see Abramowitz 
and Stegun [1], 9.1.8). This asymptotic expansion agrees with the results of 
the theorem; here we have A # 0. If (77.7) is used to compute {Y,,(z)}, then 
roundoff errors will result in {v,} terms. Since the evolution of these terms 
is much smaller than the {Y,,(z)} terms, this will be stable computation. 
Table 77.1 shows the computation of {Y,,(5)} using (77.7). The values of 
Y,(5) and Y2(5) were used to initialize the recurrence relation. For large 
value of n, the computation is accurate to all decimal places. 
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Table 77.2. A recursion computation of the Bessel functions {J,} using (77.7). 
This computation is not stable. 


Yn Jn(5) 

yi = —0.3275791376 J1(5) = —0.3275791376 
ya = 0.04656511628 Jo(5) = 0.04656511628 
ys = 0.2611405461 Js(5) = 0.2611405461 
yio = 0.00146780258 J10(5) = 0.00146780265 
yi2 = 0.0000762771 J12(5) = 0.0000762781 
yi4 = 0.000002778 J14(5) = 0.000002801 
yie = —0.00000065 Jig(5) = —0.000000077 
y2o = —0.0016 Joo(5) = 2.7 x 107)? 
yso = —10’ J3o(5) = 2.7 x 10722 


There are other Bessel functions that satisfies the recursion in (77.7), 
1 n 
the {Jn(z)}. It can be shown that J,(z) ~ a (=) as n — oo (see 


Abramowitz and Stegun [1], 9.1.7), which indicates that Jn(z) ~ B(z/2n)”. 
If (77.7) is used to compute {J,(z)}, then roundoff errors will result in 
{tun} terms. Since the evolution of these terms is much greater than the 
{Jn(z)} terms, this will be an unstable computation. Table 77.2 shows 
the computation of {J,,(5)} using (77.7). The values of J:(5) and Jo(5) 
were used to initialize the recurrence relation. For a few values of n, the 
computation is accurate. For n above about 10, however, the computational 
values are not meaningful. 


Notes 

{1] Van der Laan and Temme (6] indicate the results of applying the above 
theorem to Bessel functions (as we have), confluent hypergeometric functions 
(two different recursions), incomplete beta functions, Legendre functions 
(recursion with respect to order and with respect to degree), Jacobi polyno- 
mials. and repeated integrals of the error function. All cases of the theorem 
are illustrated. 

[2] The exponential integrals E,(z) = i t-"e—** dt have the recurrence re- 
lation nEn41(z) = e~* — zEn(z),n = 1,2,.... This relation is studied in 
Gautschi [3]. 

[3] For the integrals In, Jn, and Kn 


co te~** t? n 
I = ——— | — dt, 
alc) / (1+¢?)vt (=) 
oo et t? ) 
Jn(c) := es fs a 
() o (1+t?)vt (a 


co ect ? n 
K,(c) := — |— ] dt, 
a I vt (a) 
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with c > 0 and n > 0, Acton [2] finds the recurrence relations: 


Peta 4nI, + 2cKy, 
4n-1 °’ 

Fens 4nJn + 2cIn-1 
4n —3 : 


Ka-1 = Kn + Jn-1- 
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Applicable to __ Definite integrals. 


Yields 
A numerical quadrature scheme. 


Idea 
Using symbolic operators, quadrature rules can be devised. 
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Procedure 
Define the following operators: 


e The forward-differencing operator A: 
Af (zo) = f(to + h) — f(z0) 
A? f(zo) = A[Af(zo)] = Af(zo + h) — Af (zo) 
e The backward-differencing operator V: 
Vf (zo) = f(xo) — f(zo — h) 
V? (zo) = VIVF(z0)] = VF(zo) — VF (t0 — h) 
e The stepping operator E: 
Ef(zo) = f(to + h) 
E? f(xo) = E[Ef(xo)] = f(zo + 2h) 
E” f (x0) = f(xo + nh). 
The obvious relationships among these operators are A = & — 1 and 
V =1-E7}. Since the above operators are linear operators, the usual 
laws of algebra can be applied. Hence, several other relationships between 
the operators can be developed, such as: EV = A, E"V" = A”, and 
A" fo = V"fn (where fn = f(tn) = f(z0 + nh)). 
Since y, = E"yo and x = nh, we have 


; a: or ean | 
vn = aa Yo) = hint’ Yo) = 7 log E)(E" yo), 


1 ie be 
or D = h log £, where D denotes the differentiation operator. This is 


equivalent to E = e*?. The integration operation, which is the inverse 
operator to D, can be represented as f = D~! = h/ log E. 


Example 

Using the above operators, we can derive many quadrature rules. Start 
with f, = f(z.) = E* fo, multiply by dz = hds, and then integrate from 
Zo to Zr, (i.e., from s = 0 to s = 1) to obtain 


Zy 1 
/ f(x) dz = a | E* fo ds = (aeRe'h) 


Using E = 1+ A, the expression log(1+ A) may be formally expanded in a 
power series to obtain log(1 + A) = A— $A? + 4A3— 4A*+.... Dividing 
A = E-—1 by this last expression results in 


— _ h(E-1) 


log E Jo. 


s=0 


me hA 
[ t@0= a 
=h(fo+ $4 fo— GA’ fot+ HA fo —-.-) 
=h(fot 3 (fi — fo) — (fe -2f. + fo) +-.-)- 


(78.1) 
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If n terms of this formula are used, then a polynomial of degree n is 
being fit to the points Zo, £1, ..., Zn; this interpolating polynomial is then 
integrated between xo and 2,. If only the first two terms are used, then 
the trapezoidal rule is obtained in the form 


[PO teaaee fot 3h ~ fa) = Flo + fi): 


Notes 
(1] Analogous to the result in the example, we can obtain 
72 hE? ,\|°" — a(B? -1) 
[noes (teh) oo ae 


=h (2fot+2Afo+ 4A’ fot...). 


[2] If we define the central-differencing operator 6 by 5f(z0) = f(z0 + $h) — 
f(zo — $h), then the following integration rules can be found (see Beyer [(1]): 


- f(z) de = (1 EW lee cay aL a ) f 
Lyya _ 24 5760 967680 sop JO 
1 
1 6 
[fede =2(1+ 36" - debt + GE = 4) fo 


2 
2 56 
[ seerdn a4 (14 968 + Sot aie +...) fo. 


(3] The operators defined above can also be used in some clever manipulations 


* Pi"(z) Pe (2) 
of integrals. For example, Ullah [4] evaluates J = / Gan 
-1 —2z 


(with some restrictions on !, m, k, n, and p), in closed form, by first writing 
it in the form: 


’ 
A=0 


1 
I= / (1 — 2?) 7/?-P-1 pm (q)e(t-2")Pa 0/2 pe (TY) 
-1 


where D) = 0/04. 
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79. Tschebyscheff Rules 


Applicable to One-dimensional definite integrals. 


Yields 
A numerical quadrature rule. 


Idea 
In Tschebyscheff rules the weight associated with each node is con- 
stant. 


Procedure 
Tschebyscheff rules are quadrature rules of the form 


1 N 
[ fear~ Sw f(an) (79.1) 
= k=1 


Note that the weight function on the right-hand side is constant for all 
nodes in the summation. This formula can be made to be exact for all 
polynomials f(z) = x" for n = 0,1,...,N. Setting up the necessary 
equations, and then solving them, we find that w = 2/N, and the {zx} 
are the roots of the polynomial part of 


Nr. 0 for odd i, 
where 3; = > / Fel du = > ravens The polynomial part, IIy, 


has degree N. 


Example 
For N = 2 we find 


2 2 
Pp =v? —-—5 - se. 
arate exp ( 6u2 ss «12u4 ) 


= (1-55 +0()) (amet) +08) 


Therefore, [lz = x? — 1/3 and so x, = +£1//3 = £0.5773. 
For N = 3 we find the polynomial part of P3 to be Il3 = x? — 2/2. 
Hence, for N = 3, the nodes are located at 1, = {0,+1/V/2}. 
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Notes 
[1] The reason that Tschebyscheff rules are of interest is that sometimes the 
integrand values, the f(z:), are observed with errors. In this case the 


n 


variance of the quadrature rule, ih f(z)dz = $0", wif(zi), is given by 


o? = )-"_,w?. The value of o? is minimized when all the weights are 


equal. (Presuming that the integration rule is going to integrate constants 
exactly, which results in the constraint )>, wi = 1.) 

[2] The equations [],,(z) = 0 have complex roots for N = 8 and for N > 10, 
so that there do not exist useful Tschebyscheff rules in these cases. 

{3] Tschebyscheff rules have been extended to quadrature rules with weight 
functions, f w(x) f(x) dz = 0", wf (xi), see Forster (2). 

[4] Guerra and Vincenti [6] consider quadrature rules of the form 


ff wCe)ta) de = J Aan 1° (a3) + RUD. 
1 


= h=0 j=l 
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80. Wozniakowski’s Method 


Applicable to Multidimensional integrals on a hypercube. 


Yields 
A numerical approximation scheme which uses the smallest number of 
nodes for a specified average error. 
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Idea 
Wozniakowski has devised a way to choose nodes optimally to approx- 
imate a multidimensional integral numerically. 


Procedure 
Wozniakowski’s technique applies to an integral over the d-dimensional 


unit hypercube st : 
I- [ [ weve [ f (x) dx 
0 Jo 0 
d 


where x = (21,%2,...,2a). Given a (small) value of ¢, we would like to 


approximate this integral by the formula I ~ 7 Dopa1 J (Xe), and have the 


“average error” be less than ¢. This requires determining the number of 
nodes n and determining the location of the nodes {x;}. 

If we restrict ourselves to integrands that are real and continuous 
(some class must be specified for an average error to make sense), then 
Wozniakowski finds that as e — 0, the number of nodes needed is 


n=O (2 logel*-0/) (80.1) 


Note that the number of nodes required to obtain the same accuracy using 
Monte Carlo techniques (nMonteCarlo, see page 304) or using a uniform grid 
(Nuniform, See page 323) are 


1 1 
™MonteCarlo = O (3) ’ Nuniform = O (3) . 


Hence, the number of integrand evaluations in (80.1) is far less than the 
number of evaluations needed by these other two methods. 

Wozniakowski does not give formulae on how to determine the optimal 
nodes {x,} exactly, but he does give formulae for determining nodes {X; } 


and {3} that are “nearly as good.” That is, more of these nodes are 


required for the same average accuracy, but the number of nodes required 
only increases a little (the exponent (d — 1)/2 in (80.1) changes to (d — 1) 
or d). Even with this many nodes, it represents a substantial improvement 
over using Monte Carlo methods or a uniform grid. 

The procedure for determining the node locations is straightforward. 
For each value of k, start by writing k in base 2, then in base 3, then base 
5, etc., using the first d—1 primes as the bases. As an example, we choose 
d= 6 and k = 42. Then we find: 


42 = (101010) = (1120)3 = (132)5 = (60)7 = (39):11. 
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Now, for each of these primes p, calculate the “radical inverse” for k, ¢p(k), 
which is obtained by reversing the digits of the base-p representation of k, 
then dividing the result by p', where i is the number of digits in that 
representation. We have: 


do(42) = AOU s _ FF gg(a2y = Wis _ 2 
42) = © 42) = Pe ie — 
$s(42) = [95° $7(42) = 79° $11(42) = D1 


Finally, the {x;,,} are determined by 


k+t 
n ? 


x, = (iad) = ( da(k), falk),--+dpacs(b)) 


where ¢ is some constant which Wozniakowski does not evaluate. Since this 
constant is unknown, we could delete it and use instead 


Xf = (1, 1, sony 1) — (=. d2(k), $3(k), one Ppa ()) * (80.3) 


If we do this, then the number of nodes needed varies as =| log e|? with 


q = d—1 rather than the optimal g = (d — 1)/2. Observe that, for d = 6, 
this results in (using the values in (80.2)) 


n—42 43 59 59 43 19) 


X42 = ( nm? 64? 81 125? 49” 121 


Note that we will have to recalculate the first component of each x, if we 
decide to increase n. We can avoid this recalculation by using the first d 
primes (rather than the first d— 1) and instead of the x; or the X, above, 
choose the nodes to be 


Kp, = (1,1,..-; 1) — (G2(k), b3(k), --- dpa (A) 


1 
This results in the error estimate ~|loge|? with g = d. Observe that, for 
d = 6, this produces the 42nd node 


=  _ (43 59 59 43 19 127 ) 
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x 


Figure 80. The first 100 % nodes in two dimensions. 


Example 


If 100 nodes are be used in an integration routine, then the (nearly) 


“optimal nodes,” the {%,} nodes, are shown Figure 80. 


Notes 


[1] 


[2] 


[3] 


[4] 


The technique presented in this section comes with two obvious caveats: 

(A) There is no estimate of the overall multiplicative constants needed to 
find the requisite n from the desired error €, nor do we know how 
small e¢ must be before we get into the asymptotic regime where the 
expressions for n are valid. 

(B) This technique is based on the average error, not the worst-case error, 
so we could be unlucky and do very badly for the integrand we are 
really interested in. 

In one dimension, the number of nodes needed to obtain a minimal average 

error has a more concise answer. For the class of r times continuously differ- 

entiable functions equipped with a specific type of probability distribution, 


(B l 1 1/(r+1) 
the number of nodes required is O (( | (or + 2)I +) , where Bor+2 


is a Bernoulli number. See Traub et al. [4] for details. 

Writing the nodes in (80.3) as x, = (1,1,...,1) — 2, we recognize the {2;} 
to be Hammersley points (see Davis and Rabinowitz [2]). Removing the first 
component from {z,} results in the Halton points. Berblinger and Schlier [1] 
used the Halton points as a “quasi-random” sequence of nodes in a Monte 
Carlo type computation. 

In this section we have chosen nodes to minimize the average error. Many 
results are known for the number of nodes needed to minimize the maximum 
error. For example, considering the Sobolev class of real functions defined on 
the d-dimensional unit hypercube whose r-th distribution derivatives exist 
and are bounded by one in the Zp norm, the number of nodes required is 
O (e~#/") when pr > d. See Novak [3] for details. 
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81. Tables: Numerical Methods 


Applicable to Definite integrals. 


Yields 
Quadrature rules. 


Idea 
Many tables of numerical methods for integrals have been created. 


Procedure 

As indicated in this book, there are many ways in which to derive a 
scheme that will evaluate an integral numerically. Many books and papers 
have tabulated schemes for numerically evaluating integrals. While these 
are not adaptive schemes, they are useful because they may be directly 
entered into a computer. 

In this section we merely reference where collections of quadrature 
rules may be found. Some one-dimensional and two-dimensional quadra- 
ture rules may be found starting on page 340. 


Example 1 
The book by Stroud [8] is perhaps the most comprehensive book on 
quadrature rules. It contains rules for the following regions: 


[1] the n-dimensional cube: Cy, 

[2] the n-dimensional cubical shell: C=**" 

[3] the n-dimensional sphere: S,, 

[4] the n-dimensional spherical shell: S2e!! 

(5) the surface of S,: Un 

[6] the n-dimensional octahedron: Gp 

[7] the n-dimensional simplex: T, 

[8] entire n-dimensional space with weight function exp (—zj —... — 23) 
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[9] entire n-dimensional space with weight function exp (- ret... + zh 


[10] the two-dimensional hexagon: H2 
[11] the two-dimensional ellipse with weight function [(c —c)? + y’| Te 


[(c +c)? +y?] Binge oe 
[12] the parabolic region bounded by z = a? —y?/4a? and xz = y*/4b* —b?: PAR 
[13] the parabolic region bounded by y = b — br?/a” and the z-axis.: PAR2 
[14] the parabolic region bounded by y = b— bz?/a? and y = bz? /a? — b: PAR3 
[15] a three dimensional pyramid: CN:C2 
[16] a three-dimensional cone: CN:S2 
[17] a three-dimensional torus with circular cross section: TOR3 : S2 
{18] a three-dimensional torus with square cross section: TOR3 : C2 


where Stroud’s notation for some of the regions has been used. 

For each of these regions, quadrature rules of varying degree and with 
a varying number of nodes are given. For example, Stroud reports the 
following quadrature rules for the n-dimensional cube (the numbering of 
the methods is his): 


1-1 Degree 1, 1 Node (Centroid formula) 
Node Weight 
(0,0,...,0) V 


where V represents the volume of C,, that is V = 2”. 


1-2 Degree 1, 2" Nodes (Product trapezoidal rule) 
Nodes Weights 
(+1, +1,...,+1) v/2" 


where the symbol (+s, +s,...,+s) denotes a set of 2” nodes, the 
mn signs + are assumed independent. 


2-2 Degree 2, 2n + 1 Nodes 


Nodes Weights 

(2r, 2r,..., 2r, 2r) V 

(1,r,...,7%7r)s —rTV 

(-1,r,...,7,7)s rV 
where r = /3/6 and a subscript of S indicates a symmetric set 
(i.e., all permutations) of nodes. For example: (1,r,...,7,7T)s 
denotes the n nodes: {(1,r,r,...,7), (r,1,7,..-,7), (7,7,1,.--57); 
ng Ph Peevey 

3-4 Degree 3, 2" Nodes (Product Gauss rule) 
Nodes | Weights 
Cer cer ocr er) V/2" 


where r = 1/73. 
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5-9 Degree 5, 3" Nodes (Product Gauss formula) 
Nodes Weights 
(TiysTiny-++ Tin) (Ai, Ai, +++ Ai, ) 
where each of the subscripts 7,72,...,2, ranges independently 
over the integer 1,2,3 and ry; = —1/3/5, re = 0, r3 = 3/5, 
Aj = 5/9, Ag = 8/9, A3 = 5/9. 


Example 2 
The book by Stroud and Secrest [9] contains tables of Gaussian quadra- 
ture rules for the following types of integrals: 


1] fo, f(e)de e DN, Asf (ei) 

(2) f°, —27)* f(z) de & ON, Asf(as) 

[3] f2,Q4+2)* fe) dex OM, Aif(zi) 

(4) 2, belt se) de & ON, Af (as) 

5) fee? f(a) de = ON, Aif (xi) 

[6] fe * f(x) dz = SO”, Asf (zi) 

[7] f%, lelte"*" f(a) de & ON, Aif(xi) 

8] f& Ieee"! f(x) da = SOL, Af (zi) 

(9] fi, log (1/z) f(x) de = 2", Aif(2i) 

[10] iri oe p-'e?F(p) dp = ee Aif (zi) 

(11) fo, f(x) de = Af(-1) + ON, Aif(ai) + AF(41) 
[12] f, f(z) dz » Af(-1) + ON, Aif(wi) 

(13) 2, f(x) dz % ON, Af (ai) + DM, Bor f?™ (0) 
(14) f% e7* f(a) de = ON, Aif(as) + DM, Bor f* (0). 
Example 3 


The book by Krylov and Pal’tsev [5] contains tables of quadrature 
rules for the following types of integrals: 


n i s* log £ f(c) de = J Asfla) 
t=1 
(2] i 2 log — log 7 
0 
3 [ log (= ) ton Ss f(a) 


(4) [ ” pe? log (1+=) f(a) de = STAsf(2). 


t=1 


= f(a) de = dase) 
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Notes 

[1] Stroud [8] includes in his tables all quadrature rules known to him that have, 
in his opinion, some major importance. It is an extensive list of quadrature 
rules. The ones that he deems to be particularly useful are specifically 
indicated. (Of course, there are infinitely many product rules for some 
regions; only representative samples of these rules are given.) 

[2] Appendix 4 of Davis and Rabinowitz [2] contains a comprehensive bibliog- 
raphy of tabulated quadrature rules. 
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Applicable to One-dimensional and two-dimensional definite integrals. 


Yields 
A numerical scheme. 


Idea 


There exist standard quadrature rules for numerically approximating 
integrals over intervals and different geometric shapes. 
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Procedure 

There exist standard quadrature rules for numerically integrating dif- 
ferent types of integrands. In this section are quadrature rules for nu- 
merically integrating one-dimensional and two-dimensional integrals, these 
formulas are organized by geometric shape. Most of the two-dimensional 
quadrature rules are from Abramowitz and Stegun [1]. 


Notes 

{1] For Gaussian quadrature rules, see the tables on pages 290 and 298. 

[2] For Newton-Cotes rules, see the table on page 320. For open Newton-—Cotes 
rules, see the table on page 321. 


One Dimensional Integration Rules 


In the following, € is some number between zo and rn, and f; = f(z;) = 
f(zo + jh) where h = (Zn — Z0)/n. 


(A) Trapezoidal Rule 
ue 1 1 rs 
i, f(z) dz =h (Sf fi Fhe" Jansch shu) = sy fKG). 
Zo 
(B) Modified Trapezoidal Rule 


/ " f(a) de =h (Sfot fit..-+ fn + 5m) 


+R (fat fit faa — faa) + eM FOO. 


(C) Simpson’s rule 
eS h ha) 
[Oo serar= Be + 4h h)- FIP. 
zo 
(D) Extended Simpson’s rule 


i f(a)de = 3 [Jot A(t So tot fet) 


+2(fot fat... + fon- »|-3 nh” (6) 
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(E) Euler—Maclaurin summation formula (also known as the composite trape- 
zoidal rule) 


Cn 
[o s@a 
zo 
1 1 
=h| i fot fit fet ..+ fait sfa| 
Boia gr gt Bok 2k { p(2k-1) _ -(2k—-1) 
— Fre (&- 8) -...- Gi ( (2k-1) __¢¢ ) + Rox 
On Bopsoh?**3 (2k-+2) ; 
= -1<@<1. 
where Rox (2k +2)! es: |f (z)|, with -1<6< 1. Here, 


the B,’s are Bernoulli numbers (see [1], 25.4.7). 
(F) Five-point rule for analytic functions (f must be analytic) 


zoth h 
i, f(z)dz= 13 244 (ea) +4fle0 +) + 4fle —h) 
zo—h 

—4f(zo + ih) + 4f(zo — th) +R 


alt 
where |R| < i500 @ 


i*h | k = 0,1, 2,3}. 


max | f(z)| and S is the square with vertices at {zo + 
Integration Formulae for Different Geometric Shapes 


Circumference of a circle _If I represents the circumference of the circle 
z? + y” = h?, then we have the approximate integration rules (see [1], equation 
25.4.60) 


2m 
— = i pees piibink 2m—2 
sap | few as = ae vhsin = m=) +0(h ) 
r= 


where m > 1. The following figure indicates the location of the 12 points when 
m= 6. 
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Circular region __ If C represents the circle with radius h (rz? + y? < h?), then 
we have the approximate integration rules (see [i], equation 25.4.61) 


Sa | ff sew) aedy = wflesu) +R: 
Cc i=1 


(A) n= 4, R=O(h') 


(x, Yi) 


Pema [a 
me he 


(B) n=5, R= O(h*) 


crace 
roo [a 
Lo 
roan [i 


(C)n=7, R=O(h*) 


rcs 
Too a 
ren fa 
Tema) Da 


(D) n=7, R= O(h') 


[eo fo 
ron ida 
eve) a 
Ceanew) Le 
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(E) n =9, R=O(h®) 


(zi, yi) 


cs 
Too [a 
Pano [a 
oan [a 
Pawn [4 


Squares _If S represents a square with each side of length 2h (|x| < h, |y| < h), 
then we have the approximate integration rules (see [1], equation 25.4.62 and 
Stroud [3]) 


a [ tenaedy = > ecflenn) +R: 


t=1 


(A) n=3, R= O(h?) 


eww) | 
(vino) | 
see -dee) |e 


(B) n= 3, R = O(h*) 


coc 
(hf) 
(3h, —3h) re 
$8.3) 


82. 
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(C)n=3, R= O(h’) 


crack 
Com [a 


Pano [a 


(D) n= 4, R= O(h*) 


(E) n= 4, R= O(h*) 


[en [ o 

ao [a 
1 

Ceea) La 


(F) n= 4, R=O(h*) 


pen) | 
Gamem) Lt 


a 


on 


= 
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(G) n=9, R= O(h*) 


[eo [oe 
Poo [4 
Pansy [a 
Pawo |b 


Equilateral triangle If T represents an equilateral triangle, then we have 
the approximate integration rules (see [1], equation 25.4.63) 


1 n 
war || outed =) sulci) R: 


(A) n = 4, R= O(h?) 


Cracs 
roo ta 
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(B) n=7, R= O(h*) 


[ew [ow 
fom fa 


cs co 
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Regular hexagon If H represents a regular hexagon, then we have the 


approximate integration rules (see [1], equation 25.4.64) 


wat if f(x,y) dz dy = aoe ee: 
2 


i=1 


(A)n=7, R=O(h*) 
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(B) n=7, R= O(h') 
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83. Tables: Numerically 
Evaluated Integrals 


Applicable to Specific definite integrals. 


Yields 
An exact evaluation. 


Idea 
The numerical evaluation of many integrals has been tabulated. 


Procedure 

When computers were not as common as they are now, it was useful to 
have tabulated values of certain definite integrals. Tables were published 
containing these values. 

These tables are less useful now that computers are readily available 
to perform numerical integrations as needed. They are still of occasional 
use, though, for testing new computational routines. 


Example 1 

(A) For tables of Anger functions, see Abramowitz and Stegun [2] or Bernard 
and Ishimaru [6]. 

(B) For tables of Bessel functions, see Abramowitz and Stegun [2] or 
Haberman and Harley [9]. 

(C) For tables of the cosine integral, see Abramowitz and Stegun [2], or 
reference [15]. 
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(D) For tables of elliptic functions, see Abramowitz and Stegun [2], Belyakov 
et al. [4], Fettis and Caslin (8], or Selfridge and Maxfield [13]. 

(E) For tables of the Fresnel integral, see Abramowitz and Stegun [2], 
Martz [10], or Pearcey [11]. 

(F) For tables of the Gamma function, see Abramov [1] or Pearson [12]. 

(G) For tables of the sine integral, see Abramowitz and Stegun [2], or 
reference [15]. 


(H) For a table of the transport integral [2 (e? oa see Rogers and 
Powell [14]. 
(I) For a table of the function [ a é) d€, see Anker and Gafarian [3]. 
0 
Example 2 


(A) For a computation method for computing the polygamma function, 
see DiMarzio [7]. 


Notes 

[1] Abramowitz and Stegun (2] also have tables of Clausen’s integral, Debye 
function, dilogarithm, exponential integral, Sievert integral, and Struve func- 
tions. 

[2] Many of the tables referenced in this section are now superfluous as the 
numerical values of the integrals can be readily computed. For example, 
Mathematica [16] has special commands for computing elliptic integrals, 
Fresnel integrals, dilogarithms, and many other functions. Also, for those 
functions for which a single command does not exist, the numerical integra- 
tion routine can be used. 
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Mathematical Nomenclature 


CP{a,b] The class of functions that are continuous and have p continuous 
derivatives, on the interval [a, 6]. 
E the expectation operator, see page 30. 
E the stepping operator, see page 329. 


F[u(z)) the Fourier transform of the function u(r), defined by —— Tae =| u(x)e**” dz. 
oa inverse transform, denoted by F—![U(w)], is defined by 
a U(w)e*** dy, 
H(z) Me ee, or step function, defined by 
0 ifc <0 
H(x) := J", 6(z) dz = 1/2 if2=0. 
1 ifz>0 
H[u(z)] the Hilbert transform of the function u(x), defined by [x Ho) 4 
12 


L[u(x)| the Laplace transform of the function u(x), defined by Ute ies dz. 
The inverse transform, denoted by £~*[U(s)], is defined by the Bromwich 
integral [, U(s)e** ds, where C is Bromwich contour (a contour that is 
to the right of all of the singularities of U(s), and is closed in the left 
half plane). 

L,[a, 6] The class of functions {u(z)} that satisfy [°° |u(x)|? dr < co. 

M{[f(t)] the Mellin transform of the function f(t), defused by fo t?-1 f(t) dt. 

O We say that f(z) = O(g(z)) as zr — Zo if there exists a positive 
constant C and a neighborhood U if xo such that |f(z)| < C|g(x)| for 
all z in U. 

o We say that f(x) = o(g(x)) as x — Zo if, given any yp > 0 there exists 
a neighborhood U of zo such that |f(z)| < ulg(x)| for all x in U. 
P the Weierstrass function (an elliptic integral). See page 156. 
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sgn the signum function, this returns the sign of its argument. If x > 0, 
then sgnz is +1. If x < 0, then sgnz is —1. If c = 0, then sgnz is 
indeterminate. 

6 the central-differencing operator, see page 329. 
6;; the Kronecker delta, it has the value 1 if? = j and the value 0 if 7 ¥ j. 
6(x) the delta function, it has the properties that 6(2) = 0 for z # 0, but 
fee, (x) dx = 1. 
A the forward-differencing operator, see page 329. 
€ generally a small number, usually assumed to be much less than one 
in magnitude. 
V the backward-differencing operator, see page 329. 
OS If S is a region or volume, then 0S denotes its boundary. 
\|---|| the norm of the argument. 
# This is a Hadamard finite part integral, see page 73. 
¥ This is an Ito integral, see page 187. 
¢ This is a line integral around a closed curve, see page 50 or page 168. 
f This is a principle value integral, see page 92. 
§ This is a Stratonovich integral, see page 189. 
[]~ The negative part of a function: 


i aaa OSE 


[]* The positive part of a function: 


Let = supts(e),0} = bso + slay) = {FES 20 


Index 


A 


A-integral, 57 

a-order Green’s function, 174 

Abelian integral, 51 

absolute convergence, 53 

absolute error, 248 

absolute integral, 57 

absolute value function, 43 

ACM, 260 

action, 86, 88 

adaptive quadrature, 244, 277 

Airy differential equation, 2 

Airy function, 171, 183, 234 

Aitken transformation, 252 

algebraic topology, 140 

ALGOL programs, 220, 254 

amplitude, 154 

analytic functions, 325, 342 

Anger function, 174, 348 

angular momentum, 45 

annulus, 4, 21 

antithetic variates, 310 

applications, 1, 6, 14, 20, 24, 30, 
31, 34, 40, 45 

arc-length, 157, 165 

area, 25, 27, 168 

asymptotic expansions, 48, 184, 
195, 199 

asymptotic sequence, 48, 217 

automatic quadrature routine, 244 


auxiliary asymptotic sequence, 48, 
196 

auxiliary cosine integral, 172 

auxiliary sine integral, 174 

average error, 333 

average, 30, 139 

Axiom, 117 


B 


backward Holder inequality, 207 
backward-differencing operator, 
330 
Bairy function, 171, 183 
Banach integral, 57 
BASIC programs, 262 
basis functions, 281 
Bernoulli 
numbers, 31, 35, 251, 336, 342 
polynomials, 35, 315 
Bessel 
functions, 57, 106, 174, 184, 227, 
228, 348 
integral, 327 
best rule, 303, 315, 333 
Beta function, 174, 178 
Bickley function, 175 
biharmonic equation, 23 
bilateral Laplace transform, 198 
Binet integral, 171 
Birkhoff integral, 57 
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bispherical coordinates, 113 

bits of precision, 251 

Bloch-—Gruneisen integral, 171 

Bochner integral, 57 

Bochner—Martinelli representation, 
20, 23 

Boks integral, 57 

Boole’s rule, 320 

Borel integral, 57 

Borel set, 48 

boundary conditions, 6 

boundary point, 222 

boundary value problem, 6 

bounded variation, 50, 57 

branch cut, 59, 134, 136 

branch point, 46 

Bromwich contour, 138 

Bromwich integral, 48, 141, 351 

Brownian motion, 86 

Brownian noise, 186 

Burkill integral, 56 

butterfly, 202 


C 


C programs, 254 

C? [a,b], 351 

calculus of variations, 306 
canonical form, 145 
canonical quantization, 90 
caret, 67 

Carleman inequality, 206 
Carlson notation, 156 
Carson integral, 13 
Cartan subgroup, 50 
Cartesian product regions, 324 
Catalan’s constant, 171 
Cauchy 


integrals, see integral: principal-value 


representation, 20 
theorem, 22, 36, 129, 163, 231 
Cauchy-—Green formula, 21, 23 
Cauchy—Poincaré integral theorem, 
140 
Cauchy—Riemann equations, 21, 48 
Cauchy—Schwartz—Bunyakowsky 
inequality, 206 
caustic point, 202 


Index 


caveats, 58, 228, 336 
cd function, 154 
cells, 68 
central moment, 30 
central-differencing operator, 331 
centroid formula, 338 
chain, 68 
change of variable, 38, 93, 109 
changing order of integration, 61 
characteristic function, 30 
characteristic polynomials, 326 
Chartier theorem, 66 
Chebyshev, see Tschebyscheff 
Clausen’s integral, 172, 349 
Clenshaw-—Curtis rule, 264, 265, 
281 
closed rule, 244, 321 
CMLIB, 260 
cn function, 154 
co-dimension, 202 
combinatorial sums, 31 
combinatorial topology, 52 
compact support, 30 
comparison test, 65 
complementary error function inte- 
gral, 216 
complementary error function, 172 
complementary modulus, 154 
complete elliptic integral, 154, 172 
complex Selberg integral, 179 
composite rule, 244, 284 
composite Simpson’s rule, 251 
composite trapezoidal rule, 249, 
250, 342 
compound rule, 244, 283, 288 
computer 
aided solution, 117, 192 
algebra, 117 
libraries, 260 
MIMD, 316 
programs, see programs 
SIMD, 316 
confluent hypergeometric functions, 
179 
conjugate momentum, 90 
conservative force field, 45 


Index 


constant 
Catalan, 171 
Euler, 37, 171, 198, 238 
Lebesgue, 173 
continued fractions, 203 
contour 
Bromwich, 138 
integrals, see integral: contour 
Jordan, 35 
control variates, 311 
converge in distribution, 30 
convergence test, 64, 65 
convergent integral, 93 
convergent series, 204 
convolution theorem, 141 
convolutions, 101, 140 
coordinates 
bispherical, 113 
cylindrical, 26, 113 
ellipsoidal, 114 
elliptic cylinder, 11, 114 
oblate spheroidal, 115 
orthogonal, 25, 110 
parabolic cylinder, 114 
parabolic, 114 
paraboloidal, 114 
polar, 115 
prolate spheroidal, 114 
rotational oblate spheroidal, 115 
rotational parabolic, 114 
rotational prolate spheroidal, 114 
rotational, 114, 115 
spherical, 115 
spheroidal, 114, 115 
corrected midterm rule, 288 
corrected trapezoidal rule, 288 
cosine integral, 117, 172, 348 
cosine transform, 8 
covariance, 31, 189 
critical point, 231 
cs function, 154 
cubic splines, 266, 285 
curl, 165, 166 
curvature, 27, 200, 287 
curvilinear integral, 57 
cusp, 202 
cylindrical coordinates, 26, 113 
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D 


A, 330 

6, 331 

Daniell integral, 57 

Darboux sums, 55 

Darboux theorem, 55 

Davenport theorem, 80 

Dawson’s integral, 172 

de function, 154 

De la Vallée—Possin’s integral, 57 

Debye function, 175, 349 

deferred approach to the limit, 253 

definitions, 47, 51, 244 

degree of precision, 245 

delta function, 5, 86, 352 

Denjoy integral, 57 

density function, 30, 305 

derivative information, 287, 322 

Derive, 117 

determinant, 48 

differential equations, 1, 2, 4, 5, 6, 
15, 23, 70, 86, 107, 181, 190, 
243 

differential forms, 67 

differentiation by integration, 46 

differentiation operator, 330 

digamma function, 173 

dilogarithms, 145, 172, 349 

Dirac delta function, see delta 
function 

Dirichlet function, 54 

Dirichlet integral, 57 

Dirichlet reduction, 100 

discriminant, 150 

dissipative systems, 88 

distribution derivatives, 336 

distribution function, 30 

div, 165, 167 

divergence test, 65 

divergence theorem, 167 

divergent integral, 73 

dn function, 154 

Dnestrovskii function, 175 

double Fermi-Dirac integral, 178 

ds function, 154 

Dunford integral, 57 
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E 


E, 30, 189, 246, 330 
eigenfunctions, 91 
eigenstructure, 293 
eigenvalue, 11, 91, 293 
eigenvector, 293 
electronic mail, 255 
elementary functions, 79, 170 
elementary generator, 79 
elementary integral, 168 
elementary over a field, 79 
ellipsoidal coordinates, 114 
elliptic cylinder coordinates, 11, 
114 
elliptic functions, 349 
elliptic integral, 52, 148, 154, 172, 
175, 178 
elliptic umbilic, 202 
entropy, 30 
equidistributed sequence, 314 
error analysis, 246, 294 
error function integral, 216 
error function, 81, 144, 172, 224 
Euler equation, 15 
Euler kernel, 2 
Euler’s constant, 37, 171, 198, 238 
Euler-Lagrange equation, 15, 91 
Euler—Maclaurin formula, 35, 342 
exact bounds, 218 
excerpts from GAMS, 260 
excess, 30 
expansion theorem, 91, 196 
expectation operator, 30, 189, 306 
exponential integral, 81, 117, 172, 
173, 175, 198, 215, 328, 349 
extended 
log-sine integral, 177 
rule, 325 
Simpson’s rule, 284, 341 
exterior calculus, 67 
extrapolation, 250 
extremal problems, 14 


F 


factorial function, 163, 224 
Fejer rule, 271 
Fermi-Dirac integral, 175, 178 


Index 


Feynman diagrams, 70 
Feynman path integrals, see inte- 
gral: path 
Feynman-Kac theorem, 91 
field of elementary functions, 79 
Figures, 3, 36, 38, 41, 53, 55, 71, 
87, 110, 112, 129, 131, 132, 
133, 134, 136, 138, 167, 230, 
233, 235, 236, 237, 255, 278, 
285, 302, 308, 336 
finite element method, 15 
finite transform 
cosine, 8 
Fourier cosine, 8 
Hankel, 8 
Hilbert, 13 
sine, 8 
finite-part integrals, see integral: 
finite-part 
finite-part rule, 74 
first fundamental form, 27 
first kind Abelian integral, 52 
first kind elliptic integral, 172, 175 
first moment, 26 
five-point rule, 342 
fold, 202 
force, 45 
FORTRAN programs, 220, 254, 
255, 260 
forward-differencing operator, 330 
Fourier 
cosine transform, 8, 9, 192 
series, 7 
sine transform, 8, 9, 192 
transform, 9, 12, 142, 192, 304, 
351 
fourth order polynomials, 148 
fractional integration, 75 
fractional part, 313 
fractional transformation, 156 
free software, 255 
Fresnel integral, 116, 173, 175, 176, 
349 
Frullanian integral, 157 
Fubini theorem, 61, 64 
fully symmetric, 244 


Index 


functional 
equations, 160 
integral, 86 
fundamental form, 27 
fuzzy integral, 57 


G 


Gamma function, 139, 163, 173, 
176, 224, 236, 349 
GAMS, 254, 258, 260 
gauge integral, 57 
Gauss formula, 169 
Gauss function, 178 
Gauss rule, 220, 261, 263, 265, 267, 
268, 271, 294, 297, 298, 322 
Gauss theorem, 167 
Gauss-Bonnet formula, 27 
Gauss—Hermite rule, 263, 267, 268, 
271, 297 
Gauss—Jacobi rule, 297 
Gauss-Laguerre rule, 263, 267, 268, 
271, 297 
Gauss-Legendre rule, 245, 263, 
267, 268, 270, 271, 297 
Gauss—Lobatto rule, 271 
Gauss—Radeau rule, 271 
Gaussian curvature, 27 
Gel’fand-Pettic integral, 57 
general Denjoy integral, 57 
general purpose integrators, 245 
generalized 
coordinate, 90 
Fermi-Dirac integral, 178 
Fresnel integral, 175, 176 
functions, 12 
inverse tangent integral, 176 
log-sine integral, 179 
Wirtinger inequality, 207 
generating function, 30, 35 
genus of a curve, 52 
geodesic curvature, 27 
geodesic triangle, 27 
geometric applications, 24 
global approximation, 278 
global error, 278 
gradient vector, 165 
grand integrator, 30 
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Grassman algebra, 57 
Green’s function, 5, 11, 70, 86 
Green’s representation theorem, 21 
Green’s theorem, 27, 163, 165, 169 
Gronwalls inequality, 212 
group 

icosahedral, 318 

octahedral, 318 

reflection, 318 

renormalization, 91 

sampling, 311 

symmetry, 316 

tetrahedral, 318 


H 


Hadamard finite-part integrals, see 
integral: finite-part 
half-plane geometry, 4 
half-space geometry, 4 
Halton point, 336 
Hamilton’s principle, 91 
Hamiltonian, 88 
Hammersley point, 336 
Hankel transform, 8, 9, 11 
Hardy inequality, 206 
Hardy-Littlewood supremum theo- 
rem, 206 
harmonic function, 21, 23, 85 
harmonic integral, 57 
harmonic numbers, 37 
Harnack integral, 57 
Hartley transform, 10 
Heaviside function, 71, 351 
Heisenberg principle, 212 
helix, 26 
Helmholtz equation, 11 
Helmholtz theorem, 23 
Henstock integral, 52, 57 
Herglotz representation, 22 
Hermite 
functions, 106 
polynomials, 294, 297 
transform, 12 
Hermitian matrix, 89 
Hessian, 202 
higher order logarithmic functions, 
147 
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Hilbert 
inequality, 211 
transform, 10, 12, 13, 264, 265, 
351 
hit-or-miss, 307, 308 
holomorphic function, 20, 35, 48, 
212 
Hubbell rectangular-source inte- 
gral, 176 
Hurwitz function, 176 
hyperbolic cosine integral, 172 
hyperbolic sine integral, 174 
hyperbolic umbilic, 202 
hypercube, 334 
hyperelliptic integral, 157, 178 
hypergeometric functions, 179 
Hdlder inequality, 205, 207 
Hdlder integral, 57 


I 


icosahedral group, 318 
importance sampling, 306 
improper integral, 53, 57, 92 
IMSL, 260 
incomplete 
Beta function, 178 
Gamma function, 176 
hyperelliptic integral, 178 
index, 40, 353 
inequality, 65, 205, 276 
backward Holder, 207 
Carleman, 206 


Cauchy-Schwartz—Bunyakowsky, 


206 
generalized Wirtinger, 207 
Gronwalls, 212 
Hardy, 206 
Hilbert, 211 
Holder, 205, 207 
Minkowski, 207 
Ostrowski, 207 
Tschebyscheff, 205, 207 
Wirtinger, 207 
Young, 208 
inertia, 26 
infinite asymptotic expansion, 48 
infinite series, 184, 185 


Index 


information theory, 30 
inner product, 48, 292 
integrable, 55 
integral 
Abelian, 51 
absolute, 57 
auxiliary cosine, 172 
auxiliary sine, 174 
Banach, 57 
Binet, 171 
Birkhoff, 57 
Bloch-Gruneisen, 171 
Bochner, 57 
Boks, 57 
Borel, 57 
Bromwich, see Bromwich integral 
Bromwich, 48, 141, 351 
Burkill, 56 
Carson, 13 
Clausen’s, 349 
complementary error function, 
216 
complete elliptic, 172 
complex Selberg, 179 
contour, 1, 31 
cosine, 117, 172, 348 
curvilinear, 57 
Daniell, 57 
Dawson’s, 172 
De la Vallée—Possin’s, 57 
definitions, 51 
Denjoy, 57 
Dirichlet, 57 
divergent, 73 
double Fermi-Dirac, 178 
Dunford, 57 
elementary, 168 
elliptic, 52, 148, 154, 172, 175, 
178 
equation, 70 
error function, 216 
exponential, 81, 117, 172, 173, 
175, 198, 215, 328, 349 
extended log-sine, 177 
Fermi-Dirac, 175, 178 
Feynman, 86 
finite-part, 73, 352 


Index 


integral (continued) 

first kind elliptic, 172, 175 

Fresnel, 116, 173, 175, 176, 349 

Frullanian, 157 

functional, 86 

fuzzy, 57 

gauge, 57 

Gel’fand-Pettic, 57 

general Denjoy, 57 

generalized Fermi-—Dirac, 178 

generalized Fresnel, 175, 176 

generalized inverse tangent, 176 

generalized log-sine, 179 

harmonic, 57 

Harnack, 57 

Henstock, 52, 57 

Hubbell rectangular-source, 176 

hyperbolic cosine, 172 

hyperbolic sine, 174 

hyperelliptic, 157, 178 

Holder, 57 

improper, 53, 57, 92 

incomplete hyperelliptic, 178 

inequality, 65, 205, 276 

interval, 274 

inverse tangent, 173, 176 

Ito, 187, 352 

Khinchin, 57 

Kolmogorov, 56, 57 

Lebesgue, 53, 57 

Lebesgue-Stieltjes, 54 

line, 27, 45, 57, 164 

log-sine, 177, 179 

logarithmic Fermi-—Dirac, 175 

logarithmic, see logarithmic 
integral 

logarithmic, 81, 173 

Lommel, 57 

loop, 4, 139, 352 

multidimensional, 199, 300, 304, 
316, 323 

multiple, 61, 83, 107, 199 

norm, 57 

path, 70, 86 

Pearcey, 176 

Perron, 56, 57 
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integral (continued) 


principal-value, 13, 61, 74, 75, 
92, 155, 264, 274, 352 

product, 5 

Radon, 57 

refinement, 57 

repeated, 175, 176 

representation, 1, 4, 5, 22, 43, 
224, 246 

Riemann, 54, 57 

second kind elliptic, 172, 175 

Selberg, 179 

Sievert, 177, 349 

sine, 174, 177, 349 

special form, 145, 148, 157 

stochastic, 56, 186 

Stratonovich, see Stratonovich 
integral 

Stratonovich, 189, 352 

strong variational, 57 

surface, 164 

tabulated, 190, 348 

test, 272, 303, 304, 311 

third kind elliptic, 178 

transform, 6 

transport, 349 

variational, 57 

Wu’s, 179 

Young, 57 


integrand, 48 
integration 


and differentiation, 142 

bee, 28 

by parts, 6, 15, 143, 146, 150, 
162, 189, 215, 228, 326 

contour, 129, 163 

fractional, 75 

operator, 330 

over a simplex, 284 

over circular region, 343 

over circumference of circle, 342 

over hexagon, 347 

over square, 344 

over triangle, 346 

over unit cube, 300 

Romberg, 250 

stochastic, 186 
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interpolating polynomials, 319, 331 
interval analysis, 218, 248, 274, 280 
interval integral, 274 

introduction, 243 

invariants, 301 

inverse Laplace transform, 138 
inverse tangent integral, 173, 176 
Ito integral, 187, 352 


J 


Jacobian elliptic functions, 152, 
154 

Jacobian, 38, 48, 110, 201 

Jordan contour, 35, 40 

Jordan lemma, 133, 139 


K 


K-transform, 10 

kernel, 2, 6 

Khinchin integral, 57 

Kolmogorov integral, 56, 57 

Kontorovich-Lebedev transform, 
10 

Kronecker delta, 319, 352 

Kronrod rule, 261, 263, 265, 267, 
268, 297, 298 

Kummer’s function, 176 


L 


Ly norm, 49 
Ly function, 49 
Lp[a, 6], 351 
Lagrange interpolation formula, 
319 
Lagrangian, 86, 88 
Laguerre 
functions, 106 
polynomials, 294, 296 
transform, 12 
Laplace 
differential equation, 4, 23 
kernel, 2 
method, 4, 198, 221, 230 
transform, 10, 138, 141, 198, 240, 
351 
lattice rule, 300, 315 


Index 


Laurent series, 129 
least number of nodes, 333 
Lebesgue constants, 173 
Lebesgue integral, 53, 57 
Lebesgue measurable set, 49 
Lebesgue-Stieltjes integral, 54 
Legendre 
chi function, 173 
differential equation, 4 
elliptic functions, 152 
functions, 23, 106, 107, 176 
notation, 149 
polynomials, 34, 291, 294 
relation, 154 
transform, 9 
Leibniz rule, 49, 77 
lemma 
Jordan, 133, 139 
Riemann-Lebesgue, 227 
Watson, 197, 198, 225, 238 
length, 24 
Lerch’s function, 179 
library of software, 254 
Lie algebra, 50 
Lie group, 50 
line integrals, see integral: line 
linear differential equations, 1, 6 
linearly independent, 49, 211 
Liouville 
principle, 79 
theorem, 52 
theory, 79 
Lipschitz condition, 74 
Lobatto rule, 291, 295 
log-sine integral, 177, 179 
logarithmic Fermi-Dirac integral, 
175 
logarithmic integral, 81, 173 
Lommel integral, 57 
look up technique, 170 
loop integrals, see integral: loop 
lower limit, 49 


M 


Macsyma, 117, 239 
MAPLE, 82, 117, 198 
Mathematica, 117, 140, 349 
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maximizing an integral, 14 
mean square limit, 187 
mean value theorem, 83, 246 
mean, 30, 31, 306 
measurable function, 53 
measurable set, 49 
measure, 49, 53, 186 
Mehler—Fock transform, 10 
Meijer transform, 11 
Mellin 
kernel, 2 
transform, 11, 141, 197, 198, 351 
Mellin—Barnes integral representa- 
tion, 5 
meromorphic function, 40, 49, 155 
mesh ratio, 245 
method 
Laplace, 4, 198, 221, 230 
Monte Carlo, 269, 304, 334 
number theoretic, 269, 312 
saddle point, 239 
Sag-Szekeres, 270 
stationary phase, 198, 226 
steepest descent, 198, 225, 229, 
230 
Wozniakowski, 333 
metric coefficients, 25, 110, 113 
midpoint rule, 91, 321 
midterm rule, 288 
Milne’s rule, 320 
MIMD computer, 316 
minimizing an integral, 14 
minimum variance estimator, 306 
Minkowski inequality, 207 
MIT, 28 
modified 
Struve function, 177 
trapezoidal rule, 322, 341 
modular angle, 154 
modulus, 154 
moments of inertia, 26 
moments, 30, 198 
momentum, 45, 90 
Monte Carlo method, 269, 304, 334 
Moriety identity, 32 
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multidimensional 
Fourier transform, 12 
Hilbert transform, 12 
integral, 199, 300, 323 
transformation, 97 
multiple integral, 61, 83, 107, 199 
multiplicities, 68 
multiply-connected domains, 166 


N 


V, 330 

natural boundary conditions, 15 

natural cubic spline, 285 

ne function, 154 

nd function, 154 

negative part of a function, 352 

negative variation, 50 

negligible set, 50 

Newton—Cotes rule, 220, 291, 320, 
321 

NMS, 260 

nodes, 245, 319 

nomanclature, 351 

non-uniform grid, 289, 292, 298 

non-unique representation, 302 

norm integral, 57 

normal probability function, 173 

normal vector, 165 

norms, 49, 352 

NP-hard, 139 

ns function, 154 

null rule, 245 

number of zeros, 40 

number theoretic method, 269, 312 

number theoretic rule, 301, 312 

numerical cancellation errors, 321 

numerically stable, 245 


O 


O, 351 

o, 351 

oblate spheroidal coordinates, 115 
octahedral group, 318 
one-dimensional rule, 340 
one-form, 23, 67 

one-half integral, 77 

one-sided Fourier transforms, 12 
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open rule, 245, 321 

order of a pole, 49 

order, 245, 250 

orthogonal coordinates, 25, 110 
orthogonal functions, 49 
orthogonal polynomials, 292 
orthonormal functions, 311 
oscillation of a function, 55 
Ostrowski inequality, 207 


P 


P function, 156, 351 
Padé approximant, 253 
panel rule, 245, 283 
parabolic coordinates, 114 
parabolic cylinder coordinates, 114 
parabolic umbilic, 202 
paraboloidal coordinates, 114 
parallel methods, 315 
parameter, 154 
partial differential equations, 4, 5, 
23, 86, 107 

partial fractions, 146, 149, 150, 183 
PASCAL programs, 220, 254 
path independence, 45 
path integrals, see integral: path 
path of descent, 230 
Patterson rule, 261 
Peano kernel, 246 
Peano theorem, 246 
Pearcey integral, 176 
periodic extension, 301 
permutations, 171 
Perron integral, 56, 57 
perturbation series, 71 
Pfaffian differential equations, 5 
phi function, 173 
PL/1 programs, 254 
planar triangle, 27 
Planck’s constant, 88 
Poincaré-Bertrand theorem, 61 
point 

boundary, 222 

branch, 46 

caustic, 202 

critical, 231 

Halton, 336 
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point (continued) 
Hammersley, 336 
saddle, 231 
stationary, 222, 227 
turning, 202 
Poisson 
integral formula, 4, 20 
summation formula, 39 
polar coordinates, 115 
polar moment, 26 
pole, 49 
polygamma function, 176, 349 
polyhedral symmetry rule, 316 
polyhedral symmetry, 316 
polylogarithm, 177 
polynomials 
Bernoulli, 35, 315 
characteristic, 326 
fourth order, 148 
Hermite, 294, 297 
interpolating, 319, 331 
Laguerre, 294, 296 
Legendre, 34, 291, 294 
orthogonal, 292 
third order, 148 
trigonometric, 322 
Tschebyscheff, 294 
Pompeiu formula, 22 
PORT, 260 
positive part of a function, 352 
positive rule, 245 
positive variation, 50 
positively oriented, 139 
potential field, 45 
prime number, 313, 334 
principal-value integral, 61, 74, 75, 
92, 155, 264, 274, 352 
principle of canonical quantization, 
90 
principle of the argument, 40 
probability, 30 
product 
Gauss formula, 339 
Gauss rule, 338 
integral, 5 
of gamma functions, 173 
rule, 270, 323 
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product (continued) 
trapezoidal rule, 301, 302, 338 
programs 
ALGOL, 220, 254 
BASIC, 262 
C, 254 
FORTRAN, 220, 254, 255, 260 
in text, 238, 309 
Macsyma, 239 
PASCAL, 220, 254 
PL/1, 254 
REDUCE, 239 
prolate spheroidal coordinates, 114 
propagator, 86 
psi function, 173 


Q 


QD algorithm, 204 

Quadpack, 244, 255, 280, 299 
quantum mechanics, 88, 212 
quasi-Monte Carlo method, 310 
quotient difference algorithm, 204 


R 


Radeau rule, 291, 294 

radical inverse, 335 

Radon integral, 57 

random variable, 30, 189, 305 

rank, 301 

rational functions, 145, 148, 183 

Rayleigh-Ritz method, 15 

recurrence relations, 106, 150, 204, 
325 

REDUCE, 117, 192, 239 

refinement integral, 57 

reflection group, 318 

reformulation of an integral, 142, 
160, 162 

regression methods, 311 

regularization, 66 

relative error, 248 

relatively prime, 313 

renormalization group, 91 

repeated integrals of Ko, 176 

repeated integrals of the error 
function, 175 

representation theorem, 21 
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residue theorem, 32, 129 
Richardson extrapolation, 250 
Riemann 
integrable, 55, 314 
integral, 54, 55, 57, 68 
lower integral, 55 
sheet, 59 
surface, 51 
upper integral, 55 
zeta function, 174 
Riemann-Lebesgue lemma, 227 
Riemann-Liouville fractional deriva- 
tive, 76 
rigidity, 45 
Risch theorem, 80 
Romberg extrapolation, 261 
Romberg integration, 250 
rotational 
coordinates, 114, 115 
oblate spheroidal coordinates, 
115 
parabolic coordinates, 114 
prolate spheroidal coordinates, 
114 
Rouché theorem, 44 
rule 
best, 303, 315, 333 
Boole’s, 320 
Clenshaw-Curtis, 264, 265, 281 
closed, 244, 321 
composite Simpson’s, 251 
composite trapezoidal, 249, 250, 
342 
composite, 244, 284 
compound, 244, 283, 288 
corrected midterm, 288 
corrected trapezoidal, 288 
extended Simpson’s, 284, 341 
extended, 325 
Fejer, 271 
finite-part, 74 
five-point, 342 
Gauss, 220, 261, 263, 265, 267, 
268, 271, 294, 297, 298, 322 
Gauss—Hermite, 263, 267, 268, 
271, 297 
Gauss-Jacobi, 297 
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rule (continued) 

Gauss-Laguerre, 263, 267, 268, 
271, 297 

Gauss-—Legendre, 245, 263, 267, 
268, 270, 271, 297 

Gauss-Lobatto, 271 

Gauss—Radeau, 271 

Kronrod, 261, 263, 265, 267, 268, 
297, 298 

lattice, 300, 315 

Lobatto, 291, 295 

midpoint, 321 

midterm, 288 

Milne’s, 320 

modified trapezoidal, 322, 341 

Newton-Cotes, 220, 291, 320, 
321 

null, 245 

number theoretic, 301, 312 

one-dimensional, 340 

open, 245, 321 

panel, 245, 283 

Patterson, 261 

polyhedral symmetry, 316 

positive, 245 

product Gauss, 338 

product trapezoidal, 301, 302, 
338 

product, 270, 323 

Radeau, 291, 294 

Simpson’s, 247, 251, 283, 320, 
324, 341 

tanh, 249 

trapezoidal, 249, 250, 251, 288, 
301, 302, 310, 320, 322, 331, 
341, 342 

Tschebyscheff, 291, 332 

two-dimensional, 325, 340, 343, 
344, 346, 347 

Weddle’s, 320 
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o-algebra, 49 

saddle point, 231 
Sag-Szekeres method, 270 
sample paths, 189 

sc function, 154 
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Schlafli’s integral representation, 4, 
23 

Schrédinger equation, 86, 88 

Scientific Desk, 260 

SCRUNCH, 260 

sd function, 154 

second kind Abelian integral, 52 

second kind elliptic integral, 172, 
175 

second mean value formula, 84, 85 

second moment, 26,189 

Selberg integral, 179 

self-adjoint, 18 

semi-integral, 77 

set of measure zero, 50 

Shanks transformation, 252 

Shkarofsky functions, 179 

Sievert integral, 177, 349 

sigma-algebra, 49 

signum function, 227, 352 

SIMD computer, 316 

simple closed curve, 27, 129 

simple function, 53 

simple pole, 130 

simplex, 284 

simply connected domain, 129 

Simpson’s 3/8-rule, 320 

Simpson’s rule, 247, 251, 283, 320, 
324, 341 

sine integral, 174, 177, 349 

sine transform, 8, 265 

singular point, 53, 92 

singularities, 105 

skewness, 30 

Slobin transformation, 105 

sn function, 154 

Sobolev functions, 336 

software libraries, 254 

special forms, 97 

special purpose integrators, 245 

special techniques, 181 

spherical coordinates, 115 

spheroidal coordinates, 114, 115 

splines, 263, 264, 265, 266, 269, 285 

standard order, 67 

stationary phase method, 198, 226 

stationary point, 222, 227 
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steepest descent method, 198, 225, 
229, 230 
step function, 351 
stepping operator, 330 
Stirling’s approximation, 216, 224, 
225 
stochastic 
differential equation, 190 
integral, 56, 186 
integration, 186 
Stokes formula, 69, 140 
Stokes theorem, 166 
stratified and symmetrized scheme, 
311 
stratified sampling, 311 
Stratonovich integral, 189, 352 
strong variational integral, 57 
Struve function, 177, 349 
Sturm-Liouville problem, 11 
summable function, 53 
summation, 31, 34, 39, 44, 184 
surface integral, 164 
swallowtail, 202 
symbolic methods, 329 
symmetries, 155 
symmetry group, 316 


T 


tables of integrals, 190, 348 
tables of methods, 337 
Tables, 8, 9, 31, 77, 95, 112, 113, 
146, 152, 206, 216, 241, 251, 
252, 253, 290, 294, 298, 320, 
321, 327, 328 
tangent vector, 165 
tanh rule, 249 
taxonomy, 258, 260 
Taylor series, 204, 220 
test integral, 117, 272, 303, 304, 
311 
testing quadrature rules, 272 
tetrahedral group, 318 
theorem, 52, 65, 79, 93, 116, 130, 
248, 294 
Cauchy, 22, 36, 129, 163, 231 
Chartier, 66 
convolution, 141 
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theorem (continued) 
Darboux, 55 
Davenport, 80 
divergence, 167 
expansion, 91, 196 
Feynman-Kac, 91 
Fubini, 61, 64 
Gauss, 167 
Green’s representation, 21 
Green’s, 27, 163, 165, 169 
Hardy-Littlewood supremum, 
206 
Helmholtz, 23 
Liouville, 52 
mean value, 83, 246 
Peano, 246 
Poincaré-Bertrand, 61 
representation, 21 
residue, 32, 129 
Risch, 80 
Rouché, 44 
Stokes, 166 
theta function, 39 
third kind Abelian integral, 52 
third kind elliptic integral, 178 
third order polynomials, 148 
three-dimensional transformation, 
110, 113 
topology, 52, 140 
torsional rigidity, 45 
torus, 26 
total curvature, 287 
total measure, 50 
total variation, 50 
transform 
finite Fourier sine, 8 
Fourier cosine, 9, 192 
Fourier sine, 9, 192 
Fourier, 9, 12, 142, 192, 304, 351 
Hankel, 8, 9, 11 
Hartley, 10 
Hermite, 12 
Hilbert, 10, 12, 13, 264, 265, 351 
integral, 6 
inverse Laplace, 138 
Kk, 10 
Kontorovich-Lebedev, 10 
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transform (continued) 
Laguerre, 12 
Laplace, 10, 138, 141, 198, 240, 
351 
Legendre, 9 
Mehler—Fock, 10 
Meijer, 11 
Mellin, 11, 141, 197, 198, 351 
one-sided, 12 
sine, 8, 265 
to finite interval, 95 
Watson, 35, 44 
Weierstrass, 11 
transformation 
Aitken, 252 
fractional, 156 
multidimensional, 97 
Shanks, 252 
Slobin, 105 
three-dimensional, 110, 113 
two-dimensional, 110, 112 
unnamed, 105 
Wolstenholme, 105 
transport integral, 349 
transputers, 316 
trapezoidal rule, 249, 250, 251, 288, 
301, 302, 310, 320, 322, 331, 
341, 342 
traverse in the positive sense, 139 
trigonometric polynomials, 322 
trilogarithm, 174 
truncating an infinite interval, 275 
Tschebyscheff 
inequality, 205, 207 
polynomials, 281, 294 
rule, 291, 332 
turning point, 202 
two-dimensional rule, 325, 340, 
343, 344, 346, 347 
two-dimensional transformation, 
110, 112 
two-form, 67 
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ULP, 280 
umbilic, 202 
unbiased estimator, 305 
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uncertainty principle, 212 

uniform approximation, 226 
uniform convergence, 53 

uniform spaced nodes, 319 
uniformly distributed sequence, 314 
unit cube integration formula, 300 
unit tangent, 139 

univalent function, 22 

unnamed transformation, 105 
upper limit, 49 

uses of integration, 45 


Vv 


Val ia,b}; 50 

variance, 30, 31, 306 
variational equations, 15 
variational integral, 57 
variational principle, 15 
Villat integral formula, 21 
Voigt function, 177 
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Watson lemma, 197, 198, 225, 238 
Watson transform, 35, 44 
wave function, 88 
Weber formula, 11 
Weber function, 177 
Weddle’s rule, 320 
wedge product, 67 
Weierstrass transform, 11 
Weierstrass P function, 156, 351 
weight function, 245, 292, 317 
weights, 245 
Weyl 
group, 50 
integral formula, 50 
integral, 77 
white noise, 186 
Wiener process, 189 
winding number, 22, 44 
Wirtinger inequality, 207 
WKB, 91 
Wolstenholme transformation, 105 
work, 45 
Wronskian, 49, 182 
Wu’s integral, 179 
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Y Z 
Young inequality, 208 z-fraction, 204 
Young integral, 57 zero-form, 67 
zeros, 40 


zeta function, 37abscissae, see 
nodes 


